All Articles

Evaluation of the Challenges of Multilingualism in Data Warehouse Development

Evaluation of the Challenges of Multilingualism in Data Warehouse Development

ScrapeHero’s data gathering was recently referenced in a research paper about “Evaluation of the Challenges of Multilingualism in Data Warehouse Development” by Nedim Dedić and Clare Stanier of Staffordshire University. The article talks about the support of different languages and the effects in Business Intelligence. We also refer to the uses of web scraping as […]

The best web scraping service

The best web scraping service

This is an open thread and the goal is to solicit comments on what the best web scraping service may look like. Please go ahead a type away and write down the ideas or requirements you think would define the best web scraping service or data scraping service. No ideas or comments are bad – […]

ScrapeHero site stats

ScrapeHero site stats

We publish a lot of data from around the web and people visit us from all around the world to read about the data and articles we publish. In this data bite we wanted to publish a map of where our visitors came from among the various countries in the world. We had visitors from […]

How Local Governments can use Web Scraping

How Local Governments can use Web Scraping

The internet is a wonderful thing and so is globalization. But when a new upstart wins big on the global scene it can cause problems in some unexpected places – small towns and cities. Companies such as Airbnb and Uber have revolutionized some industries making vast profits for themselves and even the consumer. Airbnb allows […]

How many products does Amazon sell – August 2016

How many products does Amazon sell – August 2016

UPDATE: December 2016 Amazon has about 368,876,590 products as of Dec 1, 2016. Read Updated Report Amazon sells 391,337,440 products in the US Highlights 58,407,108 Books 91,774,413 in Electronics 37,983,555 products out of the 391 million are Prime shipping eligible products

Number of products sold on the Amazon “Made on Kickstarter” store

Number of products sold on the Amazon “Made on Kickstarter” store

Amazon launched a “Made on Kickstarter” storefront and it was covered widely on most tech mags like Techcrunch, Verge, Mashable etc. The storefront is available at https://www.amazon.com/b?node=13514636011 Count of products in Top categories We decide to take a look at how many products Amazon has on launch day. Here is the breakdown for the top […]

How do startups get their data?

How do startups get their data?

Startups and Data Everybody’s gotta start somewhere – so goes the saying. Startups especially start from nothing. In today’s world full of data, the question is where do startups get their data? Let’s look at the sources of the data in the various stages of a startup. Development Phase At this stage a startup usually […]

Amazon India trounces Flipkart First with 900K Prime products

Amazon India trounces Flipkart First with 900K Prime products

The big news of the day – “Amazon launched Amazon Prime in India“. How exciting ! We decided to go beyond the PR and hype machine and look at the hard cold facts and data on what it means to the India eCommerce scene. Last month we had written a blog comparing the major e-commerce […]

Dear fake users – who does Google think you are?

Dear fake users – who does Google think you are?

Summary Google Analytics is rife with Fake or Ghost referrers, this post takes a look at how Google itself classifies these users by Age, Sex, Interests etc Anyone with a website that uses Google Analytics must have noticed quite a bit of traffic coming from “Referrals”. Some of the sites, whose names keep changing every […]

A Dash button for everything – Amazon has 163 dash buttons now

A Dash button for everything – Amazon has 163 dash buttons now

Amazon has ventured into some areas like the Dash buttons or the Echo which have a niche use. The Dash buttons let you replenish items from the Amazon store with the click of a button ! We decided to take a look at how many products you can order with their own exclusive Dash button […]

Amazon India vs Flipkart vs SnapDeal

Amazon India vs Flipkart vs SnapDeal

The India eCommerce market is going through a lot of growth. A largely untapped market due to the lack of infrastructure – logistics, electronic payments, shipping and cultural opposition to eCommerce has seen a huge uptick in acceptance and sales over the past few years. The large eCommerce players all publish various statistics on who […]

An API for every site using web scraping

An API for every site using web scraping

There is a lot of content available on the millions of websites on the Internet, and all of them involve some amount of programming to get them there, however, to get to all this content using a programmatic API isn’t really possible. If you need data scraped from a website in a specific format in […]

Turn the Internet into meaningful, structured and usable data