Web Scraping Tutorials


Step by step tutorials for web scraping, web crawling, data extraction, headless browsers, etc. Our web scraping tutorials are usually written in Python using libraries such as LXML or Beautiful Soup and occasionally in Node.js. The full source code is available to download or clone using Git.

All Tutorials

How to scrape Amazon Reviews using Python

How to scrape Amazon Reviews using Python

This tutorial is a follow-up to Tutorial: How To Scrape Amazon Product Details and Pricing using Python, by extending the Amazon price data to also cover product reviews. The scope of this tutorial is limited to web scraping an Amazon product page to retrieve review summary and the first page of customer reviews for any […]

Tutorial: How to setup a simple chatbot for Facebook

Tutorial: How to setup a simple chatbot for Facebook

Earlier this year Mark Zuckerberg introduced the Facebook chat bot to the world. A simple chatbot is supposed to be capable of understanding queries made to it in a specific format and provide the appropriate answers. A Facebook chatbot can be integrated with its Messenger service and can be used to answer simple queries. Facebook […]

Tutorial: Web Scraping Hotel Prices using Selenium and Python

Tutorial: Web Scraping Hotel Prices using Selenium and Python

Everyone would like to pay the least amount of money for the best hotel room – simple isn’t it? In this tutorial we will show you how to make your own little tracking web scraper for scraping Hotels.com so that you can snag the room you want at the lowest rate. All you need to […]

An API for every site using web scraping

An API for every site using web scraping

There is a lot of content available on the millions of websites on the Internet, and all of them involve some amount of programming to get them there, however, to get to all this content using a programmatic API isn’t really possible. It feels like somehow the creators of the Internet protocols forgot this essential […]

Tutorial: How to Scrape LinkedIn for Public Company Data

Tutorial: How to Scrape LinkedIn for Public Company Data

We are glad that you came here to learn how to scrape LinkedIn and we won’t disappoint you. In this tutorial we will show you how to scrape the data in a LinkedIn company page. For those who stumbled onto this page without a clear understanding of why they wanted to scrape LinkedIn data, here […]

How To Scrape Amazon Product Details and Pricing using Python

How To Scrape Amazon Product Details and Pricing using Python

In this tutorial¬† we will build an amazon scraper for extracting product details and pricing. We will build this simple web scraper using python and LXML and run it in a console. But before we start, let’s look at what can you use it for. What can you use an Amazon Scraper for ? Scrape […]

Turn the Internet into meaningful, structured and usable data