ScrapingBee logo

The ScrapingBee Blog

We help you get better at web-scraping: detailed tutorials, case studies and writings by industry experts.

Don't know where to begin?

Check out our most popular articles.

Web scraping without getting blocked Web scraping without getting blocked Web scraping in Python Web scraping in Python Web scraping in NodeJS Web scraping in NodeJS Web scraping in R Web scraping in R Web scraping in C++ Web scraping in C++ Web scraping in C# Web scraping in C# Web scraping in Php Web scraping in Php Web scraping in Scala Web scraping in Scala Java web scraping Book Java web scraping Book Web scraping in Ruby Web scraping in Ruby Web scraping in Go Web scraping in Go Web scraping in Elixir Web scraping in Elixir Web scraping in Rust Web scraping in Rust Web scraping in Perl Web scraping in Perl No code web scraping No code web scraping No code competitor monitoring No code competitor monitoring
The Best JavaScript Web Scraping Libraries
11 min read

The Best JavaScript Web Scraping Libraries

Discover the best JavaScript web scraping libraries for 2025. We compare Playwright, Puppeteer, Cheerio, and more with code examples, pros, and cons to help you choose the right tool.

Ilya Krukowski
7 min read

urllib3 vs. Requests: Which HTTP Client is Best for Python?

We compare urllib3 vs. Requests to show you which is best suited for different scenarios.

Karthik Devan
40 min read

Python Web Scraping: Full Tutorial With Examples (2025)

Learn about web scraping in Python with this step-by-step tutorial. We will cover almost all of the tools Python offers to scrape the web. From Requests to BeautifulSoup, Scrapy, Selenium and more.

Kevin Sahin
19 min read

Python HTML Parsers

Web scraping comes in handy when collecting large amounts of data from the internet. This roundup shares a list of popular Python HTML parsers you can use to simplify web scraping.

Karthik Devan
11 min read

What is Screen Scraping and How To Do It With Examples

Unlock data from any source! Learn Python screen scraping for web, GUIs, and terminals. Practical examples, tools, and tips to get you started.

Grzegorz Piwowarek
56 min read

Web Scraping with R Tutorial: Scraping BrickEconomy.com

In-depth R web scraping tutorial. Master data extraction with rvest, httr2, & chromote. Handle JavaScript, pagination, avoid blocks & analyze results. Code included.

Ismail Ajagbe
32 min read

ChatGPT Scraping - How to Vibe Scrape with ChatGPT

Can ChatGPT scrape the web for product data? We tested it on Apple’s refurbished store and documented the journey from vibe coding to real scraping.

Karthik Devan
20 min read

How to bypass PerimeterX anti-bot system in 2025

Learn how to bypass PerimeterX/HUMAN anti-bot system with working examples that you can use straight away to scrape the data you need.

Ilya Krukowski
11 min read

Playwright MCP - Scraping Smithery MCP database Tutorial with Cursor

Discover how AI, using Model Context Protocol (MCP), can scrape web data without code, showcasing the Playwright MCP's potential and limitations in web scraping.

Karthik Devan
28 min read

The Best Web Scraping Tools & Software in 2025

Web scraping tools & software are used to extract data from the internet. Here is our list of the best web scraping tools for 2025.

Kevin Sahin
8 min read

Web Scraping with Perl

In this tutorial, you will learn the basics of using Perl for web scraping and data extraction and parsing with the help of the TreeBuilder library.

Alexander M
24 min read

Web Scraping with Ruby

Learn web scraping with Ruby with this step-by-step tutorial. We will see the different ways to scrape the web in Ruby through lots of example gems like Nokogiri, Kimurai and HTTParty.

Ilya Krukowski
13 min read

Web Scraping with Scala - Easily Scrape and Parse HTML

This tutorial covers the main tools and techniques for web scraping in Scala. You will learn how to use the Jsoup library to parse HTML with Scala and render Javascript with Selenium.

Grzegorz Piwowarek
17 min read

BrowserUse: How to use AI Browser Automation to Scrape

Explore AI-powered browser automation with BrowserUse. Learn to scrape data, log in and create reports using Python scripts and clear step-by-step prompts.

Ilya Krukowski
21 min read

How to find all URLs on a domain’s website (multiple methods)

Crawl any website! Step-by-step guide to finding all URLs on a domain to make scraping all their content easy. Multiple methods that are easy to follow.

Ilya Krukowski
Next