Featured Articles

Recent Articles

May 13, 2022

How to Build a Football Data Scraper Step-by-Step

Scraping football data (or soccer in the US) is a great way to build a comprehensive dataset that can then be used to help us create stats dashboards, run cross-analysis and use the insights for sports journalism or fantasy leagues. Whatever your goal is, scraping football data can help you

ScraperAPI Team
Apr 20, 2022

Build an eBay Web Scraper: How to Extract Product Data Using Javascript

Build an eBay Web Scraper: How to Extract Product Data Using JavaScript eBay is one of the largest eCommerce platforms in the world. With over 1 billion active listings on its site, it is also one of the largest data gold mines for pricing analysis, online purchase trends, and more.

ScraperAPI Team
Apr 20, 2022

XPath Cheat Sheet for Web Scraping: Full Guide and XPath Examples

XML Path Language (XPath) is a query language and a major element of the XSLT standard. It uses a path-like syntax (called path expressions) to identify and navigate nodes in an XML and XML-like document. In web scraping, we can take advantage of XPath to find and select elements from

ScraperAPI Team
Apr 6, 2022

How to Build a LinkedIn Scraper For Free: Step-by-Step Guide

LinkedIn is full of useful data. From high-profile leads and skilled employee candidates to huge job listings and business opportunities. All this information can be accessed by hand as it’s made publicly available for all users and non-users. But what if we want to access this data on a larger

ScraperAPI Team
Mar 31, 2022

Cheerio vs Puppeteer for Web Scraping: Picking the Best Tool for Your Project

Cheerio vs Puppeteer: Differences and When to Use Them Cheerio and Puppeteer are both libraries made for Node.js (a backend runtime environment for Javascript) that can be used for scraping the web. However, they have major differences that you need to consider before picking a tool for your project. Before

ScraperAPI Team
Mar 1, 2022

How to Scrape Stock Market Data in Python [Practical Guide, Plus Code]

Whether you’re an investor tracking your portfolio, or an investment firm looking for a way to stay up-to-date more efficiently, creating a script to scrape stock market data can save you both time and energy. In this tutorial, we’ll build a script to track multiple stock prices, organize them into

ScraperAPI Team
Feb 10, 2022

How to Deal with Pagination in Python Step by Step Guide [Full Code]

If you’re working on a large web scraping project (like scraping product information) you have probably stumbled upon paginated pages. It’s standard practice for eCommerce and content sites to break down content into multiple pages to improve user experience. However, web scraping pagination adds some complexity to our work. In

ScraperAPI Team
Feb 3, 2022

What is Data Parsing in Web Scraping? [Code Snippets Inside]

What is Data Parsing? Overview and Tools for Web Scraping Data parsing is one of the most crucial and delicate steps in any web scraping project – even if we don’t see everything that happens behind the scenes. However, the quality of our data depends heavily on the quality of

ScraperAPI Team
Jan 6, 2022

Simple Guide to Building a PHP Web Scraper Using Goutte for Beginners

PHP is a widely used backend language. Hated by many, and used for a lot of applications like WordPress. However, when thinking about web scraping PHP isn’t the first option that comes to mind. With tools like Scrapy for Python or Cheerio for Node.js making web scraping simple, it’s hard

ScraperAPI Team
Dec 22, 2021

How to Scrape Etsy Product Data Using Rvest

Why scrape Etsy? Since being founded in 2015, Etsy has become a $30billion dollar eCommerce company with over 4.4 million active sellers and 81.9 buyers according to Statista. That’s a lot of users. Although less well-known than the ecommerce juggernaut Amazon, Etsy is one of the largest marketplaces for non-conventional

ScraperAPI Team
Nov 10, 2021

Scrape Data from Google Search Using Python and Scrapy [Step by Step Guide]

Scraping Google SERPs (search engine result pages) is as straightforward or as complicated as the tools we use. For this tutorial, we’ll be using Scrapy, a web scraping framework designed for Python. Python and Scrapy combine to create a powerful duo that we can use to scrape almost any website.

ScraperAPI Team
Nov 3, 2021

Step by Step Guide to Build a Google Trends Scraper Using PyTrends

With more than 40.000 searches happening in Google per second, Google Trends is a powerful tool that allows us to visualize searching behavior and uncover trends in Web Search, Google News, Google Images, Google Shopping, and YouTube. A sample of that size can provide a lot of insights to inform

ScraperAPI Team