All Articles

CHART: Count of Products in Amazon.com for Top 10 categories – May 2016

CHART: Count of Products in Amazon.com for Top 10 categories – May 2016

The chart and tables below show the number of products in the Top 10 categories sold by Amazon.com. The previous data can be found here. There has been approximately an increase of 100,000 products since last year and a decrease of 100,000 products since last month. Electronics          118,328,809 Cell Phones & Accessories            79,174,534 Home & […]

Tutorial: How to Scrape LinkedIn for Public Company Data

Tutorial: How to Scrape LinkedIn for Public Company Data

We are glad that you came here to learn how to scrape LinkedIn and we won’t disappoint you. In this tutorial we will show you how to scrape the data in a LinkedIn company page. For those who stumbled onto this page without a clear understanding of why they wanted to scrape LinkedIn data, here […]

How To Scrape Amazon Product Details and Pricing using Python

How To Scrape Amazon Product Details and Pricing using Python

In this tutorial  we will build an amazon scraper for extracting product details and pricing. We will build this simple web scraper using python and LXML and run it in a console. But before we start, let’s look at what can you use it for. What can you use an Amazon Scraper for ? Scrape […]

XPaths and their relevance in Web Scraping

XPaths and their relevance in Web Scraping

XPath (XML Path Language) is a syntax for defining parts of an XML document. XPath is a query language for identifying and selecting nodes or elements in an XML document using a tree like representation of the document. XPath was defined by the World Wide Web Consortium (W3C). XPaths are one of the few ways […]

Amazon.com Statistics April 2016

Amazon.com Statistics April 2016

Here are some stats from Amazon.com Total Products sold on Amazon.com = 525,946,546 36,615,488 products are Prime Eligible 32,523,456 items Ship for Free by Amazon 21,756,577 items are Amazon Global shipping Eligible 11,740 items are Prime Pantry items 39,337,905 items are Used 15,589,574 items have a 4 Stars & Up review rating

24 hours on Twitter for the Presidential Race – Chart

24 hours on Twitter for the Presidential Race – Chart

The number of tweets on the Y Axis are per hour. The spike in Hillary Clinton’s tweets is the South Carolina win. Marco Rubio has been going head to head with Trump after the last debate and Twitter is showing it.   Who tweets for Trump? Here are his Top 5 tweeters – no surprise […]

Books sold by language on Amazon

Books sold by language on Amazon

We decided to have a look at Amazon.com books and see if it discriminates (ok maybe that is a harsh word) by language.   They, of course, don’t write these books – they just sell them. They are US headquartered and it is almost obvious that a majority of their books are probably written in […]

Demise of Kimono Labs and the fate of their users

Demise of Kimono Labs and the fate of their users

We have written about the differences between a free service and a paid web scraping service previously. Unfortunately, the 125,000 claimed “users” of Kimono Labs woke up to the rude realities of such a free web scraping service. Kimono Labs, got acquired by Palantir and gave their “beloved users” just 2 weeks to find an […]

Do people ever shut up talking about Trump?

Do people ever shut up talking about Trump?

We performed a twitter analysis and gathered the tweets mentioning the front runners in the current US Presidential nominee race. Here is a picture of the number of tweets – a total of 380,000 tweets. It appears people never shut up about the candidates they love (or hate). The quieter periods seem to be around […]

Amazon.com statistics February 2016

Amazon.com statistics February 2016

Here are some stats from Amazon.com Total Products sold on Amazon.com = 473,578,572 35,158,862 products are Prime Eligible 31,197,636 items Ship for Free by Amazon 21,317,553 items are Amazon Global shipping Eligible 9,690 items are Prime Pantry items 39,944,324 items are Used 14,723,626 items have a 4 Stars & Up review rating  

Super Bowl 50 – Sentiment analysis of #SuperBowlSunday

Super Bowl 50 – Sentiment analysis of #SuperBowlSunday

We decided to take a look at Twitter for the Super Bowl 50 between the Panthers and the Broncos and monitor the hashtag #SuperBowlSunday, before during and after the game. We monitored 33,000 tweets and they came from 27,433 unique users, so obviously we had some users who were really into it and a lot […]

Amazon Total products sold January 2016

Amazon Total products sold January 2016

The number of products sold by Amazon has increased slightly from October and as of now the count stands at 489.5 million products. This is a slight increase from the 467 million products sold in October almost back to the 485 million products in July.

Turn the Internet into meaningful, structured and usable data   

ScrapeHero Logo

Can we help you get some data?