All Articles

Connected Cars – an infographic

Connected Cars – an infographic

Why *not* scrape yourself

Why *not* scrape yourself

Before you get all kinds of ideas about what the topic of this article means – please look at the context – We are talking about Web Scraping here ! This post will talk about reason why not to do this yourself and why to call in a professional (wink wink – use ScrapeHero) You […]

Surprise – Games are big on Apple iOS Store !

Surprise – Games are big on Apple iOS Store !

Not a real surprise – but Games are big (so much for productivity though – coming it at less than 3%!)   Find more statistics at Statista

Google Play Store Application growth

Google Play Store Application growth

Find more statistics at Statista

Webscraping using Python without using large frameworks like Scrapy

Webscraping using Python without using large frameworks like Scrapy

If you need publicly available data from scraping the Internet, before creating a web scraper, it is best to check if this data is already available from public data sources or APIs. Check the site’s FAQ section or Google for their API endpoints and public data. Even if their API endpoints are available you have […]

Why pay for a web scraping service rather than get it for free

Why pay for a web scraping service rather than get it for free

Free has a price We have all heard of the saying “There is no free lunch” and no matter how many times businesses come around giving us something for free, there is always a price. So you use Google for free or Gmail for free or Facebook or Twitter or any of the companies that […]

5 tips for scraping big websites

5 tips for scraping big websites

Scraping bigger websites can be a challenge if done the wrong way. Bigger websites would have more data, more security and more pages. We’ve learned a lot from our years of crawling such large complex websites, and these tips could help solve some of your challenges 1. Cache pages visited for scraping When scraping big […]

Turn the Internet into meaningful, structured and usable data