Use Amazon Creator Storefront & Idea List Scraper with Python
Pull Amazon creator storefronts by handle: profile info and affiliate disclosure, every curated Idea List with its products and prices, and shoppable creator videos with tagged products.
1. Choose the data you need
Review the published README for supported collection modes, examples, and limits. The recipe below uses the current published input definition.
2. Prepare a source-based input
This JSON contains published prefills and required-field defaults. Review every value for your task before running it; it is not a promise of successful collection.
{
"crawlIdeaLists": true,
"handles": [
"gearvlogz"
],
"marketplaceDomain": "amazon.com",
"maxItemsPerList": 15,
"maxLists": 1,
"maxVideos": 10,
"proxyConfiguration": {
"useApifyProxy": true
},
"shopUrls": [],
"tabs": "all",
"useResidentialProxy": false
}
Download input.example.json and save your reviewed copy as input.json.
| Field | Type | Required | Description |
|---|---|---|---|
handles | array | required | Amazon influencer handles, e.g. `gearvlogz` (from amazon.com/shop/gearvlogz). Combined with `marketplaceDomain` to build the shop URL. |
shopUrls | array | optional | Full creator storefront URLs, e.g. `https://www.amazon.com/shop/gearvlogz`. Use this for non-default marketplaces or when you already have the exact URL. |
marketplaceDomain | string | optional | Amazon domain to use when building shop URLs from `handles`. |
tabs | string | optional | Which tab(s) of the storefront to extract. |
crawlIdeaLists | boolean | optional | When true, opens each Idea List (up to `maxLists`) and extracts individual products (up to `maxItemsPerList`). When false, only the list summary cards (title, declared item count, image) are emitted. |
maxLists | integer | optional | Maximum number of Idea Lists to process per shop. |
maxItemsPerList | integer | optional | Maximum number of product items to extract per Idea List. |
maxVideos | integer | optional | Maximum number of creator videos to extract per shop (tabs=all or videos). |
useResidentialProxy | boolean | optional | By default the actor uses the free AUTO (datacenter) proxy group with a homepage-priming retry, escalating to residential only after repeated blocks. Enable this to always use residential proxy from the start (higher reliability, uses paid proxy credit). |
proxyConfiguration | object | optional | Apify proxy configuration. Defaults to the free AUTO (datacenter) group. |
3. Start an Actor run
Set APIFY_TOKEN in your environment. Python 3.10 or newer is sufficient; this recipe uses no third-party packages.
Execution may incur charges. Review current pricing on Apify. The request asks for a 120-second timeout and a charge limit; these settings are subject to Apify’s pricing and do not guarantee an all-inclusive spending cap.
import json
import os
import urllib.request
# Save the schema-derived example as input.json; review and edit it first.
with open("input.json", encoding="utf-8") as stream:
actor_input = json.load(stream)
token = os.environ["APIFY_TOKEN"]
request = urllib.request.Request(
"https://api.apify.com/v2/acts/dkxfxmOdirX9IUAPn/runs?timeout=120&maxTotalChargeUsd=0.50",
data=json.dumps(actor_input).encode("utf-8"),
headers={"Authorization": "Bearer " + token, "Content-Type": "application/json"},
method="POST",
)
# This starts a potentially billable run. Do not automatically retry this POST.
with urllib.request.urlopen(request, timeout=40) as response:
run = json.load(response)["data"]
print("Run ID:", run["id"])
print("Status:", run["status"])
# Inspect and download results in Apify Console once the run succeeds.
4. Inspect the actual results
Open the run in Apify Console and wait for a successful completion. Use the published output schema to locate results and the dataset schema to understand declared views. Missing or optional record fields must not be treated as guaranteed values.
Amazon influencer storefront records: shop profiles, Idea List summaries, Idea List product items, and creator videos.
Questions before you run
Which inputs are required?
The published required fields are handles
What does this guide verify?
The fields, prefills, and schema links are rendered from the published build. This is a usage recipe, not a paid live extraction test. Source availability and collection results can vary.
What if the run request times out?
Check Apify Console before retrying. The first request may already have created a run. Do not automatically repeat a run-creation POST.
Generated from source build ed8h68NCGhkuvLpnN and its README and schemas. Source changes regenerate this guide; no third-party editorial claims are inferred.