Web Scraping Tutorials

LEARN HOW TO USE WEB SCRAPING TO ENHANCE PRODUCTIVITY AND AUTOMATION

We provide many step-by-step tutorials with source code for web scraping, web crawling, data extraction, headless browsers, etc.

Our web scraping tutorials are usually written in Python using libraries such as LXML, Beautiful Soup, Selectorlib and occasionally in Node.js.

The full source code is also available to download in most cases or available to be easily cloned using Git.

We also provide various in-depth articles about Web Scraping tips, techniques and the latest technologies which include the latest anti-bot technologies, methods used to safely and responsibly gather publicly available data from the Internet.

The community that has coalesced around these tutorials and their comments help anyone from a beginner hobbyist person to an advanced programmer solve some of the issues they face with web scraping.

These tutorials are frequently linked to as StackOverflow solutions and discussed on Reddit.

Please feel free to read and participate in the discussions with your comments.

All Tutorials

How To Optimize Playwright Web Scrapers Using Code Profiling Tools

This article guides you to understand the method of code profiling. You also learn to optimize Playwright web scrapers using code profiling tools.

How Web Scraping With Excel Works: A Tutorial

This tutorial deals with a detailed explanation of the Web Query feature in Excel and how web scraping with Excel is carried out using Web Query.

How To Block Specific Resources in Playwright

This article explains how you can block specific resources in Playwright. The later section also gives an explanation of how to block requests in Chrome.

What Are The Essential HTTP Headers for Web Scraping?

Through this article, you will learn about various HTTP headers for web scraping. Also, learn some tips for using headers in web scraping.

How to Scrape Trulia: Using Code and No Code Approaches

This article outlines a few methods to scrape data from Trulia. The scraped data provides key real estate insights to identify investment opportunities and risks, aiding you in making well-informed decisions.

How to Scrape Redfin: Using Code and No Code Approaches

Understanding Redfin data is crucial for making informed real estate decisions. This tutorial breaks down how you can scrape Redfin data efficiently.