Scrape Amazon Reviews using Google Chrome

This tutorial will show you how to scrape Amazon reviews and product data from Amazon for free using the Amazon Review Crawler available on ScrapeHero Cloud. The Amazon Review Scraper  can scrape Amazon review details such as – ASIN, Review heading, Review text, Date and more, within in seconds.

Here are the steps to Scrape Amazon Reviews:

  1. Create a ScrapeHero Cloud account and select the Amazon Product Review Crawler.
  2. Input the Amazon product URLs and filters.
  3. Run the Amazon Review Scraper and download the data in your preferred format (CSV, JSON, XML).

Check out our web scraping tutorials to learn how to scrape Amazon Product details easily using Google Chrome and how to build a Amazon Product Detail Scraper using Python.

Web scraping allows you to monitor customer sentiment of competitor and your brand by scraping reviews. ScrapeHero Cloud has pre-built scrapers which help businesses to easily gather data from e-commerce websites such as Amazon. These scrapers are pre-built and cloud-based, you need not worry about selecting the fields to be scraped nor download any software. The scraper and the data can be accessed from any browser at any time and can deliver the data directly to Dropbox.

If you don't like or want to code, ScrapeHero Cloud is just right for you!

Skip the hassle of installing software, programming and maintaining the code. Download this data using ScrapeHero cloud within seconds.

Get Started for Free
Deploy to ScrapeHero Cloud

What data are we extracting from Amazon?

For this tutorial we will only extract the following fields based on a product review page or product ASIN:

  1. Product ASIN
  2. Product Title
  3. Brand Name
  4. Reviewer Name
  5. Review Text
  6. Review Heading
  7. Review Comment Count
  8. Review Date
  9. Review Rating
  10. Reviewer Profile URL
  11. Number of people reacted helpful
  12. Review Direct URL
  13. Product attributes
  14. Review URL

Step 1: Create an account

First, we will create an account in ScrapeHero Marketplace. To sign up go to the link – https://cloud.scrapehero.com/accounts/login/ and create an account with your email address.

add-amazon-crawler

Step 2: Input the Details for the Amazon Review Scraper

There many ways you can configure the crawler to scrape Amazon review.

Domain – The website you would like to scrape can be from any Amazon domain

Filters – All Reviews or Reviews from Verified Purchases only

Sort – Sort reviews by Top-rated or Most recent

Rating Filter – You can filter reviews based on the rating that are all stars, 5 stars, 4 stars, 3 stars, 2 stars,1 star, All Positive, All Critical

Input URL

The type of input you wish to provide to the scraper can be a product review URL, product page URL or a product ASIN.

  1. URL – direct link to product page URL (eg: https://www.amazon.com/Arm-Hammer-OxiClean-Laundry-Power/dp/B0759N57C3/ref=cm_cr_arp_d_product_top?ie=UTF8 ) or product reviews URL (eg: https://www.amazon.com/Arm-Hammer-OxiClean-Laundry-Power/product-reviews/B0759N57C3/)
  2. ASIN of a product (eg: B0759N57C3)

Search Customer URL – You can add a certain text to filter custom reviews

Number of Pages to Scrape – Specify how many pages that the crawler should scrape. If you want to scrape all reviews then leave the section blank.

Step 3: Run the Amazon Review Scraper

The Amazon Review crawler page will open up and you will see the option to gather the data. Once you have clicked it the scraper will start to run and scrape Amazon reviews.

scrape-amazon

After the scrape is complete the ‘Status’ of the crawler will change from ‘Started’ to ‘Finished’. Click on ‘View Data’ to view the scraped product review data. 

Step 4: Download Amazon Review Data

You can see all the data scraped on this page. To download the scraped data click on ‘Download Data’.

A drop down to select a data format will appear. You can choose between CSV, JSON, and XML formats. After clicking on the data format option, a file will soon be downloaded with all the scraped review data.

You can get data delivered to Dropbox if you integrate the crawler account to your Dropbox account. You also have the option to schedule the data if you want to scrape Amazon review data on a timely basis. 

Go to the tab ‘Schedule’ in the table and click on the button ‘Add Schedule’. There are the options to choose the date, time, and time zone along with the options to repeat the run as often as you want – hourly, weekly, or daily. 

If you don't like or want to code, ScrapeHero Cloud is just right for you!

Skip the hassle of installing software, programming and maintaining the code. Download this data using ScrapeHero cloud within seconds.

Get Started for Free
Deploy to ScrapeHero Cloud

We can help with your data or automation needs

Turn the Internet into meaningful, structured and usable data



Please DO NOT contact us for any help with our Tutorials and Code using this form or by calling us, instead please add a comment to the bottom of the tutorial page for help

Disclaimer: Any code provided in our tutorials is for illustration and learning purposes only. We are not responsible for how it is used and assume no liability for any detrimental usage of the source code. The mere presence of this code on our site does not imply that we encourage scraping or scrape the websites referenced in the code and accompanying tutorial. The tutorials only help illustrate the technique of programming web scrapers for popular internet websites. We are not obligated to provide any support for the code, however, if you add your questions in the comments section, we may periodically address them.

Posted in:   eCommerce Data Gathering Tutorials, Web Scraping Tutorials

Responses

Jordan February 9, 2019

Hello,

Thank you for this guide – very helpful!

Is there a way to also scrape the “___ people found this helpful” field for each review using this scraping method?

Thank you!

Reply

    ScrapeHero February 10, 2019

    You should be able to edit this sitemap using the chrome extension and add that field.

    Reply

boop February 15, 2019

Hi guys, tried doing this but it didn’t scrape all the reviews, it only got like 260 out of 320. Any ideas? I did it twice, same issue

Reply

    ScrapeHero February 16, 2019

    Can you please paste the ASIN you are trying this for ?

    Reply

SV February 23, 2019

@boop is correct. There’s something wrong as it doesn’t scrape all the reviews. If there are around 190 reviews, it only scrapes 155. @ScrapeHero, can you please look that issue and let us all know why it that the case? Otherwise, it is a powerful tool but the fact that it doesn’t get all the reviews is somewhat annoying. Would appreciate a quick response. Thanks.

Reply

    ScrapeHero April 2, 2019

    We just checked this for a product with 4000+ reviews, and was able to get all of it. We did notice that amazon does not show all the reviews or cuts off the pagination abruptly if it flags you as a scraper. You might want to try scraping slower by using a higher delay.

    Reply

J.E April 2, 2019

Hello, Thanks to you, I was able to crawl reviews too easily! However, I’ve crawled 23000+ reviews several times, but only 5001 data can be collected. @ScrapeHero Can you tell me how to crawl all the reviews(23000+)? Thanks!!

Reply

Tamanna April 29, 2019

any better format to export the file, CSV is not giving you best output.

Reply

Michael June 14, 2019

Thank you for the tutorial and getting me started on web scraping! I am trying to scrape the reviews I wrote myself by going to my Amazon Profile page (Amazon does not have an option to export your own data), and create a Sitemap from there. We shall see whether I’ll be successful 🙂

Eventually, I will also try to figure out if there’s a way to compare 2 scrapes and find out what’s different between the two (to more quickly detect changes — like, new comments were added). Thanks again!

Reply

Steven March 4, 2020

Hi. I am a newbie here. This is an awesome tool. I would like to get some help from the community. I am using the JSON file provided in this link: https://gist.github.com/scrapehero/cefaf014076b953f865a63ad453d507b.

I would like to edit the JSON file to do 3 things:
1. Add the product name as a column in each line in the output. For eg: New iPad 9.7″ (2018 & 2017)…
1. Remove the next and next-href columns in the output
2. Remove the web-scraper-start-url column in the output

Can someone please share the code to be able to do the above?

Many thanks.
Steven

Reply

Akash April 23, 2020

HELLO ScrapeHero,
I have a question about which selector to use for drop down options with multiple data selections.
for example: All listings(main button) > (after clicking-dropdown options) Active listings > Inactive listings > etc.

Thanks,
your FAN.

Reply

    ScrapeHero April 24, 2020

    Sorry – it is hard to tell from a comment – the details are on the page. You could try Selectorlib or other tools to find the selector.

    Cheers!

    Reply

John Schaffer (@john_bizdev) May 20, 2020

Is there a knowledgebase that I can reference. I haven’t been able to get this tool to work for any site to create (import) a sitemap. I get errors every time I try to import, “HTTP error: status code 404, net::ERR_UNKNOWN_URL_SCHEME”. I thought it may be that I have a conflicting extension with HTTPS Everywhere, but disabling that didn’t change the resulting error. Is HTTPS an issue, or is there something else causing this error? I’m stuck.

Thanks!

Reply

JL Schaffer May 20, 2020

Is there a knowledgebase that I can reference. I haven’t been able to get this tool to work for any site to create (import) a sitemap. I get errors every time I try to import, “HTTP error: status code 404, net::ERR_UNKNOWN_URL_SCHEME”. I thought it may be that I have a conflicting extension with HTTPS Everywhere, but disabling that didn’t change the resulting error. Is HTTPS an issue, or is there something else causing this error? I’m stuck.

Thanks!

Reply

    Nick May 21, 2020

    Hi,
    You could try our pre-built Amazon Review scraper here -https://www.scrapehero.com/marketplace/amazon-reviews/ . You need to only provide a product URL or ASIN as input, no need to import site map or do any manual work.

    The site map provided in this post will need to be updated every time Amazon makes any minor change in their website structure. This issue is completely avoidable while using ScrapeHero Cloud scraper – https://www.scrapehero.com/marketplace/amazon-reviews/

    Thanks.

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

Turn the Internet into meaningful, structured and usable data   

ScrapeHero Logo

Can we help you get some data?