Scrape Indeed Job Data using Google Chrome

In this article, we will show you how to scrape job listings from Indeed using Indeed Job Scraper on ScrapeHero Cloud. It helps to gather basic data regarding jobs posted on Indeed. By scraping Indeed, you can use this to monitor jobs that fit your profile, location, salary, company, and job title.

Here are the steps to scrape job listings from Indeed:

  1. Create a ScrapeHero Cloud account and select the Indeed Job Listings Crawler.
  2. Input the Indeed job URLs and filters.
  3. Run the Indeed scraper and download the data (CSV, JSON, XML).

Web scraping allows you to monitor job portal websites easily. ScrapeHero Cloud has pre-built scrapers which help businesses to easily gather data from job websites such as Indeed. These scrapers are pre-built and cloud-based, you need not worry about selecting the fields to be scraped nor download any software. The scraper and the data can be accessed from any browser at any time and can deliver the data directly to Dropbox.

If you don't like or want to code, ScrapeHero Cloud is just right for you!

Skip the hassle of installing software, programming and maintaining the code. Download this data using ScrapeHero cloud within seconds.

Get Started for Free
Deploy to ScrapeHero Cloud

What data are we extracting?

  1. Job Title
  2. Salary
  3. Job Type
  4. Location
  5. Job Description
  6. Company Name
  7. Rating
  8. Number of Reviews
  9. Job URL
  10. Listing URL

Below is an annotated screenshot of the data fields we will be extracting:

indeed-details-to-extract

 

Step 1: Create an account

First, we will create an account in ScrapeHero Marketplace. To sign up go to the link – https://cloud.scrapehero.com/accounts/login/ and create an account with your email address.

Step 2: Input the Details for the Indeed Scraper

Go to Indeed.com and search for a job at any location (Eg: Accountant New York, NY).

Copy the search result URL and paste it into Job Listing Page URLs field of the scraper. You can enter as many search result URLs as you want by adding each new URL separated by a new line.

Ex: https://www.indeed.com/jobs?q=accountant+$27,000&l=New+York,+NY&jt=fulltime

Then input the number of job listings you would like to scrape. If you leave this field blank it will collect all the job listings.

Step 3: Run the Indeed Scraper

The Indeed crawler page will open up and you will see the option to gather the data. Once you have clicked it the scraper will start to run.

After the scrape is complete the ‘Status’ of the crawler will change from ‘Started’ to ‘Finished’. Click on ‘View Data’ to view the scraped job data.

Step 4: Download the Data

You can see all the data scraped on this page. To download the scraped data click on ‘Download Data’.

A drop down to select a data format will appear. You can choose between CSV, JSON, and XML formats. After clicking on the data format option, a file will soon be downloaded with all the scraped job data.

You can get data delivered to Dropbox if you integrate the crawler account to your Dropbox account. You also have the option to schedule the data if you want to extract job data on a timely basis.

If you don't like or want to code, ScrapeHero Cloud is just right for you!

Skip the hassle of installing software, programming and maintaining the code. Download this data using ScrapeHero cloud within seconds.

Get Started for Free
Deploy to ScrapeHero Cloud

We can help with your data or automation needs

Turn the Internet into meaningful, structured and usable data



Please DO NOT contact us for any help with our Tutorials and Code using this form or by calling us, instead please add a comment to the bottom of the tutorial page for help

 

Posted in:   Job Postings, Web Scraping Tutorials

Responses

H June 21, 2019

When I paste this into the importer box it says it’s invalid. Any help?

Reply

Syed June 23, 2019

When I copy/paste the JSON from Github, it says invalid JSON. Please help

Reply

Dan Weer October 14, 2019

I am getting the same error as the previous two posters – when I paste in the JSON it says that it is invalid. Any help would be appreciated.

Reply

Jellied February 18, 2020

I have been using this for a while and all of a sudden it stopped recording the description

Reply

    ScrapeHero February 19, 2020

    The site has probably changed (which does happen frequently) – please use the tutorial to identify the changed description field and it should work

    Reply

Comments or Questions?

Turn the Internet into meaningful, structured and usable data   

ScrapeHero Logo

Can we help you get some data?