All Articles

CHART: Count of Products in Amazon.com for Top 10 categories – May 2016

CHART: Count of Products in Amazon.com for Top 10 categories – May 2016

The chart and tables below show the number of products in the Top 10 categories sold by Amazon.com. The previous data can be found here. There has been approximately an increase of 100,000 products since last year and a decrease of 100,000 products since last month. Electronics          118,328,809 Cell Phones & Accessories            79,174,534 Home & […]

How to Scrape LinkedIn using Python

How to Scrape LinkedIn using Python

LinkedIn is one of the largest professional social media websites in the world and is a good source of social media data and job data. Using web scraping you can gather these data fields for performing analysis. We are glad that you came here to learn how to scrape LinkedIn and we won’t disappoint you. […]

XPaths and their relevance in Web Scraping

XPaths and their relevance in Web Scraping

XPath (XML Path Language) is a syntax for defining parts of an XML document. We will explain the relevance of Xpath in web scraping. XPath is a query language for identifying and selecting nodes or elements in an XML document using a tree like representation of the document. XPath was defined by the World Wide […]

Amazon.com Statistics April 2016

Amazon.com Statistics April 2016

Here are some stats from Amazon.com Total Products sold on Amazon.com = 525,946,546 36,615,488 products are Prime Eligible 32,523,456 items Ship for Free by Amazon 21,756,577 items are Amazon Global shipping Eligible 11,740 items are Prime Pantry items 39,337,905 items are Used 15,589,574 items have a 4 Stars & Up review rating

24 hours on Twitter for the Presidential Race – Chart

24 hours on Twitter for the Presidential Race – Chart

The number of tweets on the Y Axis are per hour. The spike in Hillary Clinton’s tweets is the South Carolina win. Marco Rubio has been going head to head with Trump after the last debate and Twitter is showing it.   Who tweets for Trump? Here are his Top 5 tweeters – no surprise […]

Books sold by language on Amazon

Books sold by language on Amazon

We decided to have a look at Amazon.com books and see if it discriminates (ok maybe that is a harsh word) by language.   They, of course, don’t write these books – they just sell them. They are US headquartered and it is almost obvious that a majority of their books are probably written in […]

Demise of Kimono Labs and the fate of their users

Demise of Kimono Labs and the fate of their users

We have written about the differences between a free service and a paid web scraping service previously. Unfortunately, the 125,000 claimed “users” of Kimono Labs woke up to the rude realities of such a free web scraping service. Kimono Labs, got acquired by Palantir and gave their “beloved users” just 2 weeks to find an […]

Do people ever shut up talking about Trump?

Do people ever shut up talking about Trump?

We performed a twitter analysis and gathered the tweets mentioning the front runners in the current US Presidential nominee race. Here is a picture of the number of tweets – a total of 380,000 tweets. It appears people never shut up about the candidates they love (or hate). The quieter periods seem to be around […]

Amazon.com statistics February 2016

Amazon.com statistics February 2016

Here are some stats from Amazon.com Total Products sold on Amazon.com = 473,578,572 35,158,862 products are Prime Eligible 31,197,636 items Ship for Free by Amazon 21,317,553 items are Amazon Global shipping Eligible 9,690 items are Prime Pantry items 39,944,324 items are Used 14,723,626 items have a 4 Stars & Up review rating  

Super Bowl 50 – Sentiment analysis of #SuperBowlSunday

Super Bowl 50 – Sentiment analysis of #SuperBowlSunday

We decided to take a look at Twitter for the Super Bowl 50 between the Panthers and the Broncos and monitor the hashtag #SuperBowlSunday, before during and after the game. We monitored 33,000 tweets and they came from 27,433 unique users, so obviously we had some users who were really into it and a lot […]

Amazon Total products sold January 2016

Amazon Total products sold January 2016

The number of products sold by Amazon has increased slightly from October and as of now the count stands at 489.5 million products. This is a slight increase from the 467 million products sold in October almost back to the 485 million products in July.

Gift Cards sold on Amazon – by the numbers – a whole lot of card data

Gift Cards sold on Amazon – by the numbers – a whole lot of card data

It is that time of the year again as you look at your holiday gift list and wonder what you buy for some of the people on your list. An ugly holiday sweater maybe? Maybe not. If you have walked miles and miles through malls and specialty gift stores and are about to give up, […]

Turn the Internet into meaningful, structured and usable data