Collect SERP Data in a Few Clicks

Q: How Do You Scrape SERP Results?

The simplest way to scrape SERP data is using DataPipeline : Open your ScraperAPI dashboard and create a new project Click on the “Google Search” template Paste all your target keywords on DataPipeline Specify any requirements like geotargeting or scheduling Run your project. You’ll be able to download your data in a couple of minutes You can collect data from 10,000 URLs per project, and you can create as many projects as you need. For a more advanced tutorial, check our guide on scraping keyword rankings with Python .

Get automatic updates on the latest SERP data to improve your SEO strategies, build custom tools, and populate dashboards.

No credit card required.

Join the 10,000+ data-focused companies using ScraperAPI

What SERP Data Would You Like to Collect Today?

Gather keyword positions, search results, jobs, and news from Google Search results

Track keyword positions in near real-time to identify ranking shifts and measure your SEO campaign performance with 1st-party data.

Where to start? Create a new DataPipeline project and select the Google Search template to automate keyword tracking in a couple of clicks.

Collect SERP data from your brand name and branded keywords, and discover what the web is writing about you and your products.

Where to start? Use our Google News endpoint to turn Google News result pages into ready-to-use JSON data.

JSON response

          "articles": [
        {
            "source": "MarketWatch",
            "thumbnail": "data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAAAQABAAD/2wCEAAkGBwgHBgkIBwgKCgkLDRYPDQwMDRsUFRAWIB0iIiAdHx8kKDQsJCYxJx8fLT0tMTU3Ojo6Iys/RD84QzQ5OjcBCgoKDQwNGg8PGjclHyU3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3N//AABEIAFwAXAMBIgACEQEDEQH/xAAaAAADAQEBAQAAAAAAAAAAAAACAwQFAQAG/8QANBAAAgEDAwIEBAQFBQAAAAAAAQIDAAQREiExBUETUWFxIlKBkTJCocEjYoKx4RQzNKLR/8QAGgEAAgMBAQAAAAAAAAAAAAAAAAECAwQFBv/EACURAAIDAAIABAcAAAAAAAAAAAABAgMRBCEFEjFREyIyQXGRof/aAAwDAQACEQMRAD8AsCSnhSAO5OK8NjuY8+Wc0plK8gJnnURXPEGMGUYHdFzWLDfo4PkEFge+ApoA8anbWT7bUAlyd/Fb+nFRXPVbG2fDkNKNtCnU36VNQbIOaRorKg2EZJ98Ufj4wVjT3Iya+ck65PIxFrbIg7Gbcj+kH96mk/1d5/yrh3B/INl+w2/vVsaGyqV6R9JP1e2tiQ86lh+WMZNQSdfmlwlna79nkOT9hUENmidqtQrHEERFDZz4n5v8VcqIople2AIOo3cui7uni7kMSoH0FTS25gkxDOWI/MpxVzpK4Mj5bOMknJ9KBAmoaxkcH0q3yJFTmx/TOsOkiwX7HTwsmMkeWa3QwPGr7Cvk7qLWmV/EP1q7p3WYo7VY7nWXTYELnI9az21fdIvrt9xNxfWlv/uSIH8l3b7Cs+TrlxIStrBp8mlOfsB+5qWKzRcbZqpIQBgbCpRpS9RSubJnN3dZN1cyMD+QHSv2HP1zTLKK2ikZLoaI8fBpBxn6VUsdGYs9quisKHJsltolaZymox5wpbkitBEAFcjQKOKYKkR05iu4rtMihklBKLlVGWYnCj3J2FMQALYA1HA7ZoSKvksFhibxp0SdQD4ZzvnyPpg58jiojvSAXUU9prkLLjBq40JIpMaeE4UDtRqBSg1GGoJDVrop1nai5infxo4vC048TABJzjftx/b3qpT0y23YtcvgFR6jscHHO3fbNGiI1RnBKqxA5wPTNWQ2UTxJI10gViRxjGNPzEfMfoNs1xb+6mjeK1hGjlgiZPOckcdh27US9MdVZrmaOIKSME7lhyPpt580CPSmyigeOHVLIx2cj8PH+f043Fck6ldSRoniaAm40DTvvv8A9jxtUlx4QmcQEtED8JPJHrQaqYBlixJYkk7kk1wtill6EvQAZagLCuIGmlWOIZdjhRnk1TddKv7aQJJASSufgOR96i5JPsRY/RYY7NpDI2pF1FidqxiraA+ltPzY2rS6nax21ojrcTOisAY5HyD7Uy761ayWxWNGyy4CFdhVUJT/ACdK2qDk1L5cX7MmIq0iK76EZgGbGceuK0Uk6bbP8SyTkDBBwQTkj9h34PbFY2qmLMFAwBq8zVxz2ap6rcFs24EKDAXvo44ONuAfffvU89zI8aRyTa1QfCvlULysxOWPnih10CSZRrrqlnOEUsfJRmpS9U2Ny8Dn+F4qNjUuccZxv25oJAl6HX5muTyLJNJLI2lnYsUXtvSJJUIwi4A753NADlY69nCFd858qdPeyzSFp764d+M62rMaSg1k8AmliDofJcSzEeLIz4+Y5oddT6qsItYTlpjMwKkBdgfmBNBJtvtgaq9q712YCWV5Y4hBCTlVLZCj3O5pJbGRnNMRt2N3bpbHUdEgUbIhySDyccgg4IJ7VBcIEdmT4ELHShO4HrUnjNpC5wB5UJfG9Ah4k0tqGM157h35O3YChit55vwRnHzHYVXH05EGqeXPotLSqV0IerIdRPG58hT4rGeXcgID83/laNv4KFlhj04745r01xHEuqV1UetLTLPlybyCExWEMe7nxD68VQCFGFAAHYCsu56ygyIVLHzbYVnN1C8kYssjgfyDakRXHvt7YcbLkFhkd8UwTldPhqEx3FRwkmNfamA0zqDS5Y7kk0aJJK2I0Zz6VfZWMDRh3BY+RO1aCqEXSoAHkBRpht5ai8S7M2HprtvK4QeQ3NXQ2kEO6pkju29MqHqd3JbL/D08dxQZPi23Py6aDOFBLEADzrOuOoWsTEgeK+c7cVizTyynMjlveq+kWcV5KVmLYHYHFJ9LTbx/D3OSi32z0/VLiYhIhp8gnNdg6Re3R1Sjwge8h3+1fRQWsFsNMESJ6gbn60zJzVTs9j0vH8Frr+r+Gba9EtISGlzM383H2rRXSi6UUKo7AYoSTXM1CTbOvXRXWsgsP//Z",
            "title": "Asana Review 2024 (Pricing, Pros and Cons)",
            "description": "Learn the pros and cons of Asana software in our comprehensive review. \nUnderstand pricing, features, integrations and how Asana helps agile...",
            "date": "6 days ago",
            "link": "https://www.marketwatch.com/guides/business/asana-review/"
        }, MORE DATA...

    

Spot your top SERP competitors across thousands of keywords.

Where to start? Try our Google SERP endpoint to extract search results – including its features like ads and “people also ask” boxes – in structured JSON format.

json response

              ...MORE DATA
        {
            "position": 2,
            "title": "How to Write a Book: Complete Step-by-Step Guide - 2024",
            "snippet": "Mar 2, 2022 \u2014 A step-by-step guide can help new authors overcome the intimidating parts of writing a book, allowing them to stay focused and maximize\u00a0...",
            "highlighs": [
                "writing a book"
            ],
            "link": "https://www.masterclass.com/articles/how-to-write-a-book",
            "displayed_link": "https://www.masterclass.com \u203a articles \u203a how-to-write-a..."
        }, MORE DATA...

    

Use our Google SERP endpoint to extract ad data from your target keywords. Plan ad campaigns or improve existing ones to outperform your competitors. You can use the endpoint by sending a get() request to the API or with DataPipeline with our ready-to-use template.

In the returned JSON data, you’ll find all ads inside the ads property.

json response

          "ads": [
        {
            "position": 0,
            "block_position": "top",
            "title": "Ghostwriting & Publish Service | 50% Off@ Ghost Writing Service",
            "link": "https://www.writersofusa.com/lp-1/",
            "displayed_link": "https://www.writersofusa.com \u203a signup_now_for \u203a 50%_off_offer",
            "tracking_link": "https://www.google.com/aclk?sa=l&ai=DChcSEwijv-PJmNaFAxVkBq0GHfw0Bx4YABAAGgJwdg&ae=2&gclid=EAIaIQobChMIo7_jyZjWhQMVZAatBh38NAceEAAYASAAEgKhGfD_BwE&sig=AOD64_3f7NqmjnhxrQGnx1Sl7BvsnMZLKQ&q&adurl",
            "description": "Fiction, Non Fiction, Autobiography, Screenplays or Business Reports, We do It All Here. Engaging, captivating, and top-tier Ghostwriting services at the most affordable price.We Provide Exceptional Biography Writing Services. Know More.Read Through the Information And Gain Insights On Books Editing.",
            "sitelinks": [
                {
                    "site_title": "Biography Writing",
                    "site_link": "https://www.writersofusa.com/biography-writing",
                    "site_description": "We Provide Exceptional Biography Writing Services. Know More."
                },
                {
                    "site_title": "Books Editing",
                    "site_link": "https://www.writersofusa.com/book-editing",
                    "site_description": "Read Through the Information And Gain Insights On Books Editing."
                }
            ]
        }, MORE DATA...

    

Google shows different data based on where you are. Use our geotargeting feature to collect SERP data as locals would.

Where to start? After creating a Google Search project in DataPipeline, set the country and TLD to your preferred settings – you can also use geotargeting with our APIs.

Advertising available jobs on Google is a best practice for any job board website or company site looking to attract more candidates.

Where to start? Use our Google Jobs endpoint to gather all available jobs for key positions.

json response

          "jobs_results": [
        {
            "title": "Data Engineer",
            "company_name": "Vision Service Plan (VSP)",
            "location": "Anywhere",
            "link": "https://www.google.com/search?ibp=htl;jobs&q=data+engineering&htidocid=5YcWW_9sTWOhzz6XAAAAAA%3D%3D&hl=en-US&kgs=1f5697c317c4b532&shndl=-1&source=sh/x/im/textlists/detail/m1/1#fpstate=tldetail&htivrt=jobs&htiq=data+engineering&htidocid=5YcWW_9sTWOhzz6XAAAAAA%3D%3D",
            "via": "Virtual Vocations",
            "description": "A company is looking for a Data Engineer.\n\nKey Responsibilities...\n\u2022 Create and maintain data pipelines for key data and analytics capabilities\n\u2022 Collaborate with team to develop optimal data integration and transformation solutions\n\u2022 Build and maintain data pipelines using appropriate tools and practices\n\nRequired Qualifications:\n\u2022 Bachelor's degree in computer science, data science, statistics, economics, or related field\n\u2022 4+ years' experience in a development team providing analytical capabilities\n\u2022 4+ years of hands-on experience in data preparation, SQL, integration tools, ETL/ELT/data pipeline design\n\u2022 Experience with data integration platforms and data warehouse MPP platforms\n\u2022 Familiarity with event store and stream processing, API development platforms, and agile development environments",
            "extensions": [
                "Posted 5 days ago",
                "Work from home",
                "Employment Type Full-time"
            ]
        }, MORE DATA...

    

Gather Millions of Search Results Efficiently

Need more than 3M API credits a month?
Get in touch with our team of experts to get a custom plan that fits your goals, including +100 concurrent threads, an account manager, and premium support

Extract SERP Data Fast

Get structured JSON Data from Google Search

Get structured JSON data from our available Google endpoints with a simple API call.

Our endpoints are available across all our tools.

Streamline SERP Data Collection with Low-Code

Using DataPipeline’s visual scheduler, you’ll be able to build entire scraping projects to convert SERP data from Google domains into JSON or CSV data.

Add the keywords you want to keep track of, set the intervals for data collection, and get a continuous flow of data right where you need it — in an app, folder, or email.

Monitor up to 10,000 queries or URLs per project in just a couple of clicks.

Get Unique SERP Insights

Dig deeper than surface-level SEO insights and get a 360-degree overview of SERPs continuously.

Set data collection intervals to track your competitors’ moves, and get organic and paid results in seconds.

No credit card required

Get Localized SERP Data From Anywhere

With an extensive pool of premium proxy providers across 50+ countries, you can access SERPs in any country or region as local customers would.

Use ScraperAPI’s custom parameters to get a more granular view of local SERPs.

Geotargeting is included in all plans.

Add Fresh Data to Your SEO Tools and Reports

Developing a custom SEO tool or automating reports? Collect SERP data at custom intervals and get updates on traffic spikes without worrying about your IP getting blocked, handling CAPTCHAs, or parsing.

Connect data with your app or workflow with a simple webhook.

Speed Up Turnaround on Large eCommerce Scraping Projects

Achieve higher scraping speed with our Async Scraper:

Let us manage timeouts, retries, anti-scraping mechanisms and any other complexity, and focus on getting the insights you need.

40M IPs Around
the World

50+
Geolocations

99.9%
Uptime Guarantee

Unlimited
Bandwidth

Professional
Support

Use the Right Tool — Power Up Your Infrastructure or Go Low-Code

No matter the level of complexity, ScraperAPI is designed to fit any use case.

API

Integrate ScraperAPI to your existing infrastructure to improve the performance of your scrapers, achieve higher success rates, and increase scraping speed.

DataPipeline

Automate your entire data pipeline at scale without writing a single line of code. Save on maintaining costly coding infrastructures and managing complex scrapers.

Async Scraper

Handle millions of requests at a near 100% success rate with a simple Post() request. Scale your data collection for even the toughest domains.

SERP Data Uses Cases

Data is just the first step – Here are a few ideas you can explore in your business

👉 Monitor your competitors' ads

Improve your search ad campaigns with 1st-party data.

👉 Find top competitors in local SERPs

Use geotargeting to explore localized search results to enter new markets.

👉 B2B lead generation

Spot potential local customers by scraping Google Maps

What Our Customers
Are Saying

One of the most frustrating parts of automated web scraping is constantly dealing with IP blocks and CAPTCHAs. ScraperAPI gets this task off of your shoulders.

based on 50+ reviews

The team at ScraperAPI was so patient in helping us debug our first scraper. Thanks for being super passionate and awesome!

A dead simple API plus a generous free tier are hard to beat. ScraperAPI is a good example of how developer experience can make a difference in a crowded category.

I researched a lot of scraping tools and am glad I found ScraperAPI. It has low cost and great tech support. They always respond within 24 hours when I need any help with the product.

Simplify SERP Scraping with ScraperAPI

Test It Free For 7 Days

Hobby

$49

/ month

Annual Hobby

$49

$44

/ month, billed annually

Startup

$149

/ month

Annual Startup

$149

$134

/ month, billed annually

Business

$299

/ month

Annual Business

$299

$269

/ month, billed annually

Working on large projects and want to test longer?

Get a free consultation from our web scraping experts.

FAQs about SERP Data Scraping

What is SERP Data?

Search engine result page (SERP) data is the information a search engine returns after the user submits a query.

When using ScraperAPI to scrape Google SERPs, it’ll turn every element in the search result page into structured JSON data, allowing you to collect, store, and manipulate the elements within a search result like “people also ask” and “related searches” box, ranking data, and etc.

How Do You Scrape SERP Results?

The simplest way to scrape SERP data is using DataPipeline:

Open your ScraperAPI dashboard and create a new project
Click on the “Google Search” template
Paste all your target keywords on DataPipeline
Specify any requirements like geotargeting or scheduling
Run your project. You’ll be able to download your data in a couple of minutes

You can collect data from 10,000 URLs per project, and you can create as many projects as you need. For a more advanced tutorial, check our guide on scraping keyword rankings with Python.

Is It Legal to Scrape Google Search Results?

Yes, it is legal to scrape Google search results because they are publicly available. Of course, that doesn’t mean Google wants you to scrape them, so you’ll have to use a tool like ScraperAPI to bypass its anti-scraping mechanisms and keep your IP safe.

Try ScraperAPI for free with 5,000 API credits.

Async Scraper Service

Structured Data

DataPipeline

Scraping API

Large-Scale Data Acquisition

Ecommerce

Market Research Firms

SEO Agencies

Travel Agencies and Hotels

VCs and Hedge Funds

AI and ML

SERP Data Collection

Ecommerce Data Collection

Market Research Scraper

Real Estate Data Collection

cURL

Python

NodeJS

PHP

Ruby

Java

DataPipeline

Developer Guides

Free Downloads

Product FAQs

Case Studies

Webinars

Comparisons

Learning Hub

Glossary

Blog

Async Scraper Service

Structured Data

DataPipeline

Scraping API

Large-Scale Data Acquisition

Ecommerce

Market Research Firms

SEO Agencies

Travel Agencies and Hotels

VCs and Hedge Funds

AI and ML

SERP Data Collection

Ecommerce Data Collection

Market Research Scraper

Real Estate Data Collection

cURL

Python

NodeJS

PHP

Ruby

Java

DataPipeline

Developer Guides

Free Downloads

Product FAQs

Case Stuides

Webinars

Comparisons

Learning Hub

Glossary

Blog

Collect SERP Data in a Few Clicks

What SERP Data Would You Like to Collect Today?

Gather Millions of Search Results Efficiently

Extract SERP Data Fast

Get structured JSON Data from Google Search

Streamline SERP Data Collection with Low-Code

Get Unique SERP Insights

Get Localized SERP Data From Anywhere

Add Fresh Data to Your SEO Tools and Reports

Speed Up Turnaround on Large eCommerce Scraping Projects

Use the Right Tool — Power Up Your Infrastructure or Go Low-Code

SERP Data Uses Cases

What Our Customers Are Saying

Simplify SERP Scraping with ScraperAPI

Working on large projects and want to test longer?

FAQs about SERP Data Scraping

What Our Customers
Are Saying