Turn in-demand domains into easy-to-use APIs and get structured data with a simple get() request.
In addition to our standard API, we’ve created an ever-growing list of additional API endpoints you can use to retrieve structured data from domains like Amazon and Google (more domains to come) with a simple get() request. This means you don’t have to build complex URLs anymore.
Instead of having to build and maintain your own parsers, our team will help by identifying and handling any page structure changes, to ensure you’re receiving the accurate and constant flow of data you need.
Benefits of Structured Data Endpoints: More Data, Less Code
Even if you’re already using ScraperAPI for collecting data from our supported domains, moving to our Structured Data endpoints will bring additional benefits:
- Work with JSON data for a more flexible workflow
- Enjoy a 99.99% success rate for supported domains and avoid unnecessary errors
- Reduce development and maintenance costs and time
- Get reliable and consistent data at scale without worrying about page structure changes
- Scrape structured data without having to generate complex URLs
Note: We’ve designed these Structured Data endpoints to take care of URLs for you. However, we recommend you check our Auto Parsing feature if you need to work with customized URLs (for example, a customized Amazon product URL).
Getting Started with Structured Data Endpoints [Amazon Example]
Using our Structured Data endpoints is even easier than using our standard API, as they streamline URL generation and allow you to retrieve structured JSON data from any of our supported domains.
To see it in action, let’s scrape https://www.amazon.com/dp/B09R93MDJX/?th=1 using the Amazon Product Details endpoint – which uses your API key and the ASIN number of the product page as parameters in the request.
We’ll use Requests in Python for this simple script and print the response to the terminal:
import requests
payload = {
'api_key': 'YOUR_API_KEY',
'asin': 'B09R93MDJX'
}
response = requests.get('https://api.scraperapi.com/structured/amazon/product', params=payload)
print(response.text)
After running our script, here’s the returned JSON:
{
"name": "Ampere Shower Power - Hydropower Bluetooth Shower Speaker, Waterproof Detachable Portable, Rechargeable Mini Speaker (Chrome)",
"product_information": {
"package_dimensions": "7.76 x 4.41 x 4.09 inches",
"item_weight": "1.95 pounds",
"asin": "B09R93MDJX",
"batteries": "1 Lithium Ion batteries required. (included)",
"customer_reviews": {
"ratings_count": 35,
"stars": "3.8 out of 5 stars"
},
"best_sellers_rank": [
"#3,386 in Portable Bluetooth Speakers",
"#19,205 in MP3 & MP4 Player Accessories"
],
"date_first_available": "January 27, 2022",
"manufacturer": "Ampere"
},
"brand": "Visit the Ampere Store",
"brand_url": "https://www.amazon.com/stores/Ampere/page/9C39E858-3C64-4A00-8874-12B8AADCAB6B?ref_=ast_bln",
"full_description": "Product Description\nRead more\n360° SPEAKERS The cylindrical design delivers immersive audio that plays evenly in all directions.\nBIG BUTTONS Play, pause and skip tracks directly on the speaker with the big easy-to-touch buttons.\nALWAYS HAVE MUSIC IN THE SHOWER Once installed, Shower Power never needs to be removed.\nRead more\nRead more",
"pricing": "$99.00",
"list_price": "",
"shipping_price": null,
"availability_status": "",
"images": [
"https://m.media-amazon.com/images/I/31KKeBcl-NL.jpg",
"https://m.media-amazon.com/images/I/41gv1XZqBmL.jpg",
"https://m.media-amazon.com/images/I/41Qw+17FCEL.jpg",
"https://m.media-amazon.com/images/I/41sU4zf0Y6L.jpg",
"https://m.media-amazon.com/images/I/519iXpFvQJL.jpg",
"https://m.media-amazon.com/images/I/41nl2K4wu+L.jpg"
],
"product_category": "Electronics › Portable Audio & Video › Portable Speakers & Docks › Portable Bluetooth Speakers",
"average_rating": 3.8,
"small_description": "About this item \n \nPOWERED BY WATER: Our proprietary hydropower system uses the water you are already using in the shower for power so you always have a fully charged speaker. SIMPLE TO USE: Shower Power seamlessly integrates into your daily routine. It turns on automatically, automatically pairs, and automatically turns off. BIG SOUND, small size: The cylindrical design delivers big immersive audio that plays evenly in all directions and is designed for bathroom acoustics. MADE FROM RECYCLED OCEAN PLASTIC: Shower Power is made from recovered ocean plastic but that’s not all, it is also delivered in 100% plastic-free packaging. WORKS ON (ALMOST) ANY SHOWER: Shower Power installs onto nearly any showerhead — rain, fixed, or handheld.",
"feature_bullets": [
"POWERED BY WATER: Our proprietary hydropower system uses the water you are already using in the shower for power so you always have a fully charged speaker.",
"SIMPLE TO USE: Shower Power seamlessly integrates into your daily routine. It turns on automatically, automatically pairs, and automatically turns off.",
"BIG SOUND, small size: The cylindrical design delivers big immersive audio that plays evenly in all directions and is designed for bathroom acoustics.",
"MADE FROM RECYCLED OCEAN PLASTIC: Shower Power is made from recovered ocean plastic but that’s not all, it is also delivered in 100% plastic-free packaging.",
"WORKS ON (ALMOST) ANY SHOWER: Shower Power installs onto nearly any showerhead — rain, fixed, or handheld."
],
"total_reviews": 35,
"total_answered_questions": 5,
"customization_options": {
"color": [
{
"asin": "B09R93MDJX",
"is_selected": true,
"value": "Chrome",
"image": "https://m.media-amazon.com/images/I/31KKeBcl-NL.jpg"
},
{
"asin": "B09R9LDKZP",
"is_selected": false,
"value": "Black",
"image": "https://m.media-amazon.com/images/I/31m-FVxKB6L.jpg"
}
],
"style": [
{
"asin": "B09R93MDJX",
"is_selected": true,
"value": "Shower Power",
"image": null
},
{
"asin": "B09R95153K",
"is_selected": false,
"value": "Shower Power Pro",
"image": null
}
]
},
"seller_id": null,
"seller_name": null,
"fulfilled_by_amazon": null,
"fast_track_message": " \n \n",
"aplus_present": true
}
By sending your request through the Amazon Product Details endpoint, ScraperAPI will provide you with all relevant data points including, but not limited to:
| Data Point | JSON Name |
|---|---|
| Product’s name | name |
| Product’s price | price |
| Product information like weight, dimensions and ASIN code | package_dimensions, item_weight, asin |
| Product images | images |
| Customization options like color and variants | color, style |
This is a standard response when using the Amazon-specific API for product pages, so take your time to understand how data is organized to make the most out of our structured data.
Side Note:
Just for contrast, here’s a portion of the same response but without Auto Parsing enabled:
HTML is burdened with unnecessary information and a sea of irrelevant tags, making it harder to work with – you can learn more about scraping Amazon in our tutorial.
Extracting Specific Data Points from the Response
Picking specific fields from the response is as easy as using the .json() method – in the case of Python – on the response and traversing the data using the designated pairs.
Here’s a simple example of extracting the product’s name, price, and ASIN:
import requests
product_data = []
payload = {
'api_key': '5bc85449d28e162fb0416d6c5b4ac5b0',
'asin': 'B09R93MDJX'
}
response = requests.get('https://api.scraperapi.com/structured/amazon/product', params=payload)
product = response.json()
product_data.append({
"product_name": product["name"],
"product_price": product["pricing"],
"product_ASIN": product["product_information"]["asin"]
})
print(product_data)
Which returns:
[
{
"product_name": "Ampere Shower Power - Hydropower Bluetooth Shower Speaker, Waterproof Detachable Portable, Rechargeable Mini Speaker (Chrome)",
"product_price": "$99.00",
"product_ASIN": "B09R93MDJX"
}
]
For Every Use, an Endpoint
Unlike our standard API, you don’t need to generate a list of custom URLs. Instead, if you need specific data, you can use the proper endpoint with the required parameters.
Let’s use the example above. What if you want to gather more information about the product’s reviews? We can use the https://api.scraperapi.com/structured/amazon/review endpoint to collect it:
import requests
payload = {
'api_key': 'YOUR_API_KEY',
'asin': 'B09R93MDJX'
}
response = requests.get('https://api.scraperapi.com/structured/amazon/review', params=payload)
print(response.text)
Here’s how this response looks like this time:
{
"average_rating": 3.8,
"total_ratings": 35,
"filtered_total_ratings": null,
"total_reviews": null,
"filtered_total_reviews": null,
"5_star_ratings": 17,
"5_star_percentage": 0.48,
"4_star_ratings": 5,
"4_star_percentage": 0.14,
"3_star_ratings": 5,
"3_star_percentage": 0.14,
"2_star_ratings": 5,
"2_star_percentage": 0.13,
"1_star_ratings": 4,
"1_star_percentage": 0.11,
"product": {
"url": "https://www.amazon.com/Ampere-Shower-Power-Hydropower-Rechargeable/dp/B09R93MDJX/ref=cm_cr_arp_d_product_top?ie=UTF8",
"name": "Ampere Shower Power - Hydropower Bluetooth Shower Speaker, Waterproof Detachable Portable, Rechargeable Mini Speaker (Chrome)",
"brand": "Ampere",
"price": null,
"image": "https://m.media-amazon.com/images/I/31KKeBcl-NL.jpg",
"variation": {
"style": "Shower Power",
"color": "Chrome"
}
},
"top_positive_review": {...},
"top_critical_review": {...},
"reviews": [...],
"pagination": [
"https://www.amazon.com/Ampere-Shower-Power-Hydropower-Rechargeable/product-reviews/B09R93MDJX/ref=cm_cr_arp_d_paging_btm_2?ie=UTF8&pageNumber=2"
]
}
Note: We’re only showing a portion of the entire response due to space constraints, but you can take a look at the full Amazon Review response sample here.
As you can see, review data (including the paginated pages’ URLs) from the target product page is returned in JSON format:
Review Example
{
"stars": 4,
"date": "Reviewed in the United States on August 7, 2022",
"verified_purchase": true,
"manufacturer_replied": false,
"username": "Dustin Rowe",
"user_url": "https://www.amazon.com/gp/profile/amzn1.account.AHZ6N34S5HQOQDTWL2DLATOKW2JA/ref=cm_cr_arp_d_gw_btm?ie=UTF8",
"title": "Great shower accessory for music lovers!",
"review": "Fast shipping, product looks and feels great. Very fast and easy installation with included instructions. Pairing was quick and simple, the overall look of the shower head isn't tacky either, I really love the stainless finish to match the plumbing. Although they say pressure will be slightly reduced/lost I personally haven't noticed a difference. The LED lights work and look great, the color to temperature feature is useful for those that require a bit a a waiting period to get your shower up to your preferred temperature. This just out the guessing game making you constantly stick your arm in to test the temperature. Overall I gave it 4.5 out of 5, the sound quality is slightly muffled and flat, the bass is good and volume is no issue, fit and finish is excellent the portability is great and a bold risk but worth it. I would buy again and gift as well!",
"review_url": "https://www.amazon.com/gp/customer-reviews/R23XSXA3JMPD79/ref=cm_cr_arp_d_rvw_ttl?ie=UTF8&ASIN=B09R93MDJX",
"total_found_helpful": null,
"images": [],
"variation": {
"style": "Shower Power Pro",
"color": "Chrome"
},
"video_url": null
}
Top Positive Review Example
{
"stars": 4,
"date": "Reviewed in the United States on August 7, 2022",
"verified_purchase": false,
"manufacturer_replied": false,
"username": "Dustin Rowe",
"user_url": "https://www.amazon.com/gp/profile/amzn1.account.AHZ6N34S5HQOQDTWL2DLATOKW2JA/ref=cm_cr_arp_d_gw_lft?ie=UTF8",
"title": "Great shower accessory for music lovers!",
"review": "Fast shipping, product looks and feels great. Very fast and easy installation with included instructions. Pairing was quick and simple, the overall look of the shower head isn't tacky either, I really love the stainless finish to match the plumbing. Although they say pressure will be slightly reduced/lost I personally haven't noticed a difference. The LED lights work and look great, the color to temperature feature is useful for those that require a bit a a waiting period to get your shower up to your preferred temperature. This just out the guessing game making you constantly stick your arm in to test the temperature. Overall I gave it 4.5 out of 5, the sound quality is slightly muffled and flat, the bass is good and volume is no issue, fit and finish is excellent the portability is great and a bold risk but worth it. I would buy again and gift as well!",
"review_url": "https://www.amazon.com/gp/customer-reviews/R23XSXA3JMPD79/ref=cm_cr_arp_d_viewpnt?ie=UTF8&ASIN=B09R93MDJX#R23XSXA3JMPD79",
"total_found_helpful": null,
"images": [],
"variation": {},
"video_url": null
}
Get Localized Structured JSON Data from Across 50+ Countries [Google Search Example]
ScraperAPI uses over 40M different IPs across the world, allowing you to send your requests from almost anywhere. We understand how important it is to get accurate, localized data, so you can use the country_code parameter when sending your request through our Structured Data endpoints to get the localized data you need.
A great example to showcase this feature is Google Search. Based on your location, the search engine results pages (SERPs) will look very different, so setting the parameter to the target country will help you see the results and features a local user will see:
import requests
payload = {
'api_key': 'YOUR_API_KEY',
'country': 'us',
'query': 'project+management+software'
}
response = requests.get('https://api.scraperapi.com/structured/google/search', params=payload)
print(response.text)
In this case, the Google Search endpoint takes the parameter query with the keyword you want to search – note: you’ll need to replace the spaces with a plus (+) symbol – and we added the code US so ScraperAPI would only use US-located IPs.
Here’s how a standard organic result will look like in JSON:
Organic Result Example
"organic_results":[
{
"position":3,
"title":"Best Project Management Software Of 2023 - Forbes",
"tags":"5 days ago — ",
"snippet":"5 days ago — The best project management software of 2023 offers affordable plans, robust features, customizable tools, and an easy-to-use interface.",
"highlighs":[
"project management software"
],
"link":"https://www.forbes.com/advisor/business/software/best-project-management-software/",
"date":"",
"displayed_link":"https://www.forbes.com › advisor › business › best-proj...",
"thumbnail":null,
"sitelinks":{
"inline":[
],
"block":[
]
}
},
.
.
.
The response will also contain all elements in the SERP, including the pagination:
{
"search_information":{
"total_results":1830000000,
"time_taken_displayed":0.53,
"query_displayed":"project management software"
},
"shopping_link":"https://www.google.com/search?q=project+management+software&gl=US&hl=en&source=lnms&tbm=shop&sa=X&ved=2ahUKEwjXke-AyN38AhU0LFkFHdjsCysQ_AUoA3oECAEQBQ",
"ads":[...],
"organic_results":[...],
"related_questions":[...],
"related_searches":[...],
"pagination":{...}
}
For comparison, let’s see what happens when we changed the country code to the UK:
"organic_results": [
{
"position": 5,
"title": "The Best Project Management Software for 2023 - PCMag",
"tags": "",
"snippet": "The Best Project Management Software for 2023 · OUR TOP TESTED PRODUCTS · GanttPro · Teamwork · Zoho Projects · Celoxis · LiquidPlanner · ProofHub · Redmine.",
"highlighs": [
"Project Management Software"
],
"link": "https://www.pcmag.com/picks/the-best-project-management-software",
"date": "",
"displayed_link": "https://www.pcmag.com › ... › Project Management",
"thumbnail": null,
"sitelinks": {
"inline": [],
"block": []
}
},
As you can see, the first organic result in the UK version is in position 5 after the ads, while in the US the first organic result is in position 3.
Note: Check the full Google Search JSON response sample to familiarize yourself with the structure of the returned data.
💡 Pro Tip
Although we’re using the Google Search API in this example, you can also use geotargeting with all Amazon- and Google-specific APIs. It also counts with a tld parameter you can set for extra context.
This is especially useful in cases where, for example, you’re interested in US prices (so amazon.com is used), but you want to be specific with sellers that deliver to Canada (so CA ge targeting is enabled).
Check the full list of valid country and tld values in our documentation.
With our robust list of available countries, you’ll be able to scrape accurate localized data from any world location without the risk of getting banned, blocked, or missing information.
If you want to try our Structured Data endpoints by yourself, create a free ScraperAPI account and experience all our features for seven days without any commitment. Alternatively, subscribe to one of our paid plans to take full advantage of ScraperAPI in a few minutes.
