Custom scrapers for the sites with no data API
Our 35 data APIs cover Amazon, Walmart, Google and YouTube. Every other site runs on the AI scraper: you paste a URL, define the columns you want in a Custom Schema, and the AI fills them from the rendered page on your schedule. 120 retailers across Europe and the United States are written up below, each with the columns it returns and what a run on it actually cost.
120 retailers, written up one by one
Every page below answers the same four questions for one retailer: what the AI scraper gets, what it cannot get, why that site's own API does not tell you what a competitor is charging, and what a month of daily runs costs at a tier we measured rather than guessed. Sixty of them also print real rows from a run we did, with the date on them. The list is not the limit — it is the worked proof that any public website goes the same way: define the columns once in a Custom Schema, paste the URLs, done.
120 of 120 retailers
Electronics 23
- Electronics retailer
MediaMarkt
Europe's largest electronics chain, read as columns you choose: price, the strikethrough above it, delivery, store pickup and the energy label.
mediamarkt.demediamarkt.atmediamarkt.es+3Read the write-up → - Electronics
Newegg
First-party and marketplace offers on the same component page.
newegg.comnewegg.caRead the write-up → - Electronics
Best Buy
Open-box tiers and a price-match policy that moves the shelf number.
bestbuy.combestbuy.caRead the write-up → - Electronics retailer
Alza
The Czech and Slovak electronics retailer that sets the price for its market: price, stock, delivery and pickup availability as columns you choose.
alza.czalza.skalza.hu+2Read the write-up → - Electronics
Worten
Portuguese electronics pricing, with Spain on the same platform.
worten.ptworten.esRead the write-up → - Electronics
Altex
Romanian electronics pricing with instalment pricing shown alongside.
altex.roRead the write-up → - Electronics
Conrad Electronic
Industrial and electronics catalogue with business and consumer prices.
conrad.deconrad.atconrad.chRead the write-up → - Electronics
Currys
UK electronics pricing including the price-promise adjustments.
currys.co.ukcurrys.ieRead the write-up → - Electronics retailer
Coolblue
The Dutch electronics retailer whose delivery clock is part of the price. Product and search pages both answer a plain fetch, which makes this one of the cheapest sites on this list to watch, and the reason this page can show real rows.
coolblue.nlcoolblue.becoolblue.deRead the write-up → - Electronics
Galaxus
Swiss-German pricing with a public price history on every product.
galaxus.degalaxus.chgalaxus.atRead the write-up → - Electronics
Adorama
The second quote in every pro imaging price comparison.
adorama.comRead the write-up → - Electronics
B&H Photo Video
Pro photo and video pricing, with MAP-constrained prices hidden behind the basket.
bhphotovideo.comRead the write-up → - Electronics
Boulanger
The other French electronics specialist, priced against Darty.
boulanger.comRead the write-up → - Electronics
Crutchfield
Car and home audio with fitment data attached to the price.
crutchfield.comRead the write-up → - Electronics
Darty
French electronics with a published price-match contract.
darty.comRead the write-up → - Electronics
Digitec
Swiss electronics pricing in CHF, from the Galaxus group.
digitec.chRead the write-up → - Electronics
MediaWorld
Italian electronics pricing from the MediaMarkt group.
mediaworld.itRead the write-up → - Electronics
Micro Center
In-store-only pricing that is published per branch.
microcenter.comRead the write-up → - Electronics
Mindfactory
German component pricing that moves several times a day.
mindfactory.deRead the write-up → - Electronics
Morele
Polish component pricing that reprices against Allegro hourly.
morele.netRead the write-up → - Electronics
PcComponentes
Iberian component pricing across four markets from one catalogue.
pccomponentes.compccomponentes.ptpccomponentes.frRead the write-up → - Electronics
Saturn
German electronics pricing that tracks MediaMarkt almost exactly.
saturn.deRead the write-up → - Electronics
Unieuro
Italian electronics pricing, head to head with MediaWorld.
unieuro.itRead the write-up →
Grocery 21
- Grocery (store-level pricing)
Tesco
The UK grocery reference price, with Clubcard pricing on top.
tesco.comtesco.ieRead the write-up → - Grocery (store-level pricing)
Instacart
Marked-up grocery prices across many retailers at once.
instacart.comRead the write-up → - Grocery (store-level pricing)
Kroger
Store-level grocery pricing with a published developer portal.
kroger.comRead the write-up → - Grocery (store-level pricing)
Albert Heijn
Dutch grocery pricing with bonus promotions on a weekly cycle.
ah.nlah.beRead the write-up → - Grocery
Lidl
Discounter pricing that sets the floor across Europe and the US.
lidl.delidl.co.uklidl.comRead the write-up → - Grocery (store-level pricing)
Carrefour
French grocery pricing across four European markets.
carrefour.frcarrefour.escarrefour.itRead the write-up → - Grocery (store-level pricing)
Colruyt
Belgian grocery that guarantees the lowest price in each store's area.
colruyt.beRead the write-up → - Grocery (store-level pricing)
H-E-B
Texas grocery pricing, the market Walmart does not lead.
heb.comRead the write-up → - Grocery
Ocado
Online-only UK grocery with the deepest branded assortment.
ocado.comRead the write-up → - Grocery (store-level pricing)
Albertsons
The parent group behind Safeway, priced per banner and per store.
albertsons.comRead the write-up → - Grocery (store-level pricing)
Meijer
Midwest supercentre pricing across grocery and general merchandise.
meijer.comRead the write-up → - Grocery (store-level pricing)
Publix
Southeast US grocery pricing with a weekly ad that drives the number.
publix.comRead the write-up → - Grocery (store-level pricing)
REWE
German grocery pricing, published per store.
shop.rewe.deRead the write-up → - Grocery (store-level pricing)
Safeway
Albertsons-group pricing with a 'just for U' member layer.
safeway.comRead the write-up → - Grocery (store-level pricing)
Wegmans
Northeast US grocery with unusually deep own-brand assortment.
wegmans.comRead the write-up → - Grocery
ALDI
The other discounter floor, in Europe and the United States.
aldi.dealdi.co.ukaldi.usRead the write-up → - Grocery
EDEKA
German grocery pricing from the largest German food retail group.
edeka24.deRead the write-up → - Grocery (store-level pricing)
Gopuff
Convenience delivery pricing, set per micro-fulfilment zone.
gopuff.comRead the write-up → - Grocery (store-level pricing)
Jumbo
The second Dutch grocer, with a published partner API.
jumbo.comRead the write-up → - Grocery
Morrisons
UK grocery with a large own-brand and butchery assortment.
groceries.morrisons.comRead the write-up → - Grocery
Waitrose
Premium UK grocery, the top of the price band.
waitrose.comRead the write-up →
Marketplaces and price comparison 18
- Price comparison
Idealo
Every merchant offer on one idealo product page, read after JavaScript and returned as columns you choose. Daily schedule, REST, CSV or Excel.
idealo.deidealo.atidealo.co.uk+3Read the write-up → - Marketplace
eBay
Live listings, seller names and the sold and completed history that eBay's own API will not hand you. Daily schedule, REST, CSV or Excel.
ebay.comebay.co.ukebay.de+4Read the write-up → - Marketplace
Otto
Germany's second-largest online retailer, read as a marketplace: price, delivery, seller and variant, returned as columns you choose.
otto.deRead the write-up → - Marketplace
Kaufland
Every seller on a Kaufland offer, the winning price and who holds it, read after JavaScript and returned as columns you choose.
kaufland.dekaufland.atkaufland.cz+2Read the write-up → - Marketplace
Bol
Who holds the buy block on a bol listing, at what delivered price, and which other sellers sit underneath it.
bol.comRead the write-up → - Marketplace
eMAG
The dominant marketplace in Romania, and one of the few large European sites that still answers a plain fetch: price, seller, stock and rating as columns you choose.
emag.roemag.bgemag.huRead the write-up → - Marketplace
Allegro
Poland's dominant marketplace, where one product carries dozens of competing offers: seller, price, delivery and Smart! status as columns you choose.
allegro.plallegro.czallegro.sk+1Read the write-up → - Price comparison
Ceneo
Poland's price comparison engine, where one product page lists every shop selling it: merchant, price, delivery and rank as columns you choose.
ceneo.plRead the write-up → - Marketplace
Cdiscount
France's largest home-grown marketplace, read as a marketplace: price, seller, delivery and subscription eligibility, returned as columns you choose.
cdiscount.comRead the write-up → - Marketplace
Etsy
Handmade listings where every seller prices the same thing differently.
etsy.comRead the write-up → - Resale marketplace
Mercari
Second-hand listings where condition does most of the pricing.
mercari.comRead the write-up → - Marketplace
Temu
Session-priced listings that differ between visits and markets.
temu.comRead the write-up → - Marketplace
Fnac
The French retailer and marketplace where member pricing sits next to the public price: both, plus seller and condition, as columns you choose.
fnac.comfnac.befnac.es+1Read the write-up → - Resale marketplace
StockX
Bid and ask on a resale market, not a shelf price.
stockx.comRead the write-up → - Marketplace
Zalando
Europe's largest fashion platform, where the markdown and the size run matter more than the shelf price: both, per market, as columns you choose.
zalando.dezalando.co.ukzalando.fr+1Read the write-up → - Resale marketplace
Poshmark
Peer-to-peer fashion resale with negotiated, not listed, prices.
poshmark.comRead the write-up → - Marketplace
Fruugo
One catalogue, dozens of currencies, priced per destination market.
fruugo.comfruugo.co.ukRead the write-up → - Resale marketplace
OfferUp
Local listings where the price is tied to a radius, not a market.
offerup.comRead the write-up →
Home, DIY and furniture 16
- DIY and trade
The Home Depot
US trade pricing with per-store stock and bulk price breaks.
homedepot.comhomedepot.caRead the write-up → - Home and furniture
Wayfair
Furniture pricing across four markets, with a published partner portal.
wayfair.comwayfair.co.ukwayfair.deRead the write-up → - DIY and trade
Lowe's
The other half of the US DIY duopoly, priced per store.
lowes.comRead the write-up → - Home and furniture
IKEA
Global furniture pricing with a stable catalogue and per-market prices.
ikea.comRead the write-up → - DIY and trade
Leroy Merlin
French DIY pricing across four European markets.
leroymerlin.frleroymerlin.esleroymerlin.it+1Read the write-up → - DIY and trade
Harbor Freight
Value tool pricing with a coupon layer on top of the shelf price.
harborfreight.comRead the write-up → - DIY and trade
Ace Hardware
Franchise DIY where each store sets its own price.
acehardware.comRead the write-up → - Home and furniture
Crate & Barrel
Premium US home furnishing with a seasonal markdown calendar.
crateandbarrel.comRead the write-up → - DIY and trade
Menards
Midwest DIY with a rebate model that changes the effective price.
menards.comRead the write-up → - Home and furniture
Overstock (Bed Bath & Beyond)
Clearance-led furniture pricing where the list price is the moving part.
overstock.combedbathandbeyond.comRead the write-up → - DIY and trade
Screwfix
UK trade pricing, quoted ex-VAT by default for trade accounts.
screwfix.comscrewfix.ieRead the write-up → - DIY and trade
Tractor Supply
Rural lifestyle and farm supply, priced per store.
tractorsupply.comRead the write-up → - Home and furniture
West Elm
Williams-Sonoma-group furniture with frequent sitewide promotions.
westelm.comRead the write-up → - Home and furniture
Westwing
European home with a members-only flash-sale layer.
westwing.deRead the write-up → - DIY and trade
Wickes
UK consumer DIY with trade-account pricing behind a login.
wickes.co.ukRead the write-up → - Home and furniture
Williams Sonoma
Premium kitchen and home, the parent of West Elm and Pottery Barn.
williams-sonoma.comRead the write-up →
Fashion and beauty 15
- Beauty and personal care
Sephora
Prestige beauty pricing on both sides of the Atlantic.
sephora.comsephora.frRead the write-up → - Fashion
ASOS
UK and European fashion with per-market pricing on one catalogue.
asos.comRead the write-up → - Fashion
Shein
Fast-fashion pricing that turns over faster than most feeds refresh.
shein.comRead the write-up → - Fashion
Macy's
US department store pricing with layered promotional discounts.
macys.comRead the write-up → - Fashion
About You
DACH fashion with a heavy sale assortment and per-market prices.
aboutyou.deaboutyou.comRead the write-up → - Fashion
Nordstrom
Premium US department store, the ceiling in most apparel comparisons.
nordstrom.comRead the write-up → - Beauty and personal care
Notino
Pan-European beauty pricing across dozens of country storefronts.
notino.comnotino.denotino.co.ukRead the write-up → - Fashion
Abercrombie & Fitch
US and European apparel with market-specific pricing and sizing.
abercrombie.comRead the write-up → - Beauty and personal care
Douglas
DACH beauty pricing with per-size variants on one page.
douglas.dedouglas.atdouglas.chRead the write-up → - Fashion
JCPenney
Mid-market US apparel with coupon-driven effective pricing.
jcpenney.comRead the write-up → - Fashion
Marks & Spencer
UK clothing and food under one brand, priced on different cycles.
marksandspencer.comRead the write-up → - Fashion
Old Navy
Gap-group value apparel with near-continuous promotions.
oldnavy.gap.comRead the write-up → - Fashion
Urban Outfitters
Youth apparel and home across US and European markets.
urbanoutfitters.comurbanoutfitters.euRead the write-up → - Fashion
Victoria's Secret
US intimates with a semi-annual sale that defines the calendar.
victoriassecret.comRead the write-up → - Fashion
Zappos
US footwear where the price can differ by size within one product.
zappos.comRead the write-up →
Sport, hobby and pets 14
- Pet supplies
Chewy
US pet pricing with a subscription price on every line.
chewy.comRead the write-up → - Sport and outdoor
Decathlon
Own-brand sport pricing across most of Europe.
decathlon.frdecathlon.co.ukdecathlon.deRead the write-up → - Hobby and specialist
Michaels
Craft retail where the coupon is the pricing strategy.
michaels.comRead the write-up → - Sport and outdoor
REI
Outdoor gear with a member dividend and an outlet storefront.
rei.comRead the write-up → - Sport and outdoor
Academy Sports + Outdoors
Value sporting goods across the US south.
academy.comRead the write-up → - Hobby and specialist
Barnes & Noble
Book pricing across format, where the format is the price.
barnesandnoble.comRead the write-up → - Sport and outdoor
Bass Pro Shops
Hunting and fishing with per-store pricing and a sister brand.
basspro.comRead the write-up → - Hobby and specialist
GameStop
Trade-in values and pre-owned pricing alongside new.
gamestop.comgamestop.deRead the write-up → - Hobby and specialist
Guitar Center
New and used instruments priced on the same page.
guitarcenter.comRead the write-up → - Sport and outdoor
JD Sports
UK and European sportswear with limited-release pricing.
jdsports.co.ukjdsports.deRead the write-up → - Pet supplies
PetSmart
US pet retail with an own-brand assortment and pack-size pricing.
petsmart.competsmart.caRead the write-up → - Sport and outdoor
Sports Direct
UK sportswear discounter with permanently struck-through RRPs.
sportsdirect.comRead the write-up → - Hobby and specialist
Sweetwater
Music gear with serial-level listings and a MAP-heavy catalogue.
sweetwater.comRead the write-up → - Hobby and specialist
Thomann
European music gear, the largest catalogue on the continent.
thomann.dethomann.co.ukRead the write-up →
General merchandise, auto and pharmacy 13
- General merchandise
Walmart
Shelf prices that change by store, pulled per location rather than per SKU.
walmart.comRead the write-up → - General merchandise
Target
Circle pricing, store pricing and the national price, kept apart.
target.comRead the write-up → - General merchandise
Empik
Polish media and general merchandise with a marketplace layer on top.
empik.comRead the write-up → - General merchandise
Costco
Member pricing, pack sizes and the instant-rebate overlay.
costco.comcostco.cacostco.co.ukRead the write-up → - General merchandise
Argos
UK catalogue pricing with per-store stock on every line.
argos.co.ukargos.ieRead the write-up → - Auto parts
AutoZone
US auto parts priced by vehicle fitment rather than by part.
autozone.comRead the write-up → - General merchandise
John Lewis
UK department store with a never-knowingly-undersold price history.
johnlewis.comRead the write-up → - Office and business supply
Staples
US and Canadian office supply with contract pricing behind a login.
staples.comstaples.caRead the write-up → - Pharmacy and health
Walgreens
US pharmacy and convenience pricing with a published developer portal.
walgreens.comRead the write-up → - General merchandise
El Corte Inglés
Spanish department store across grocery, fashion and electronics.
elcorteingles.eselcorteingles.ptRead the write-up → - Auto parts
Halfords
UK auto and cycling with a fitting service priced into the product.
halfords.comRead the write-up → - Office and business supply
Office Depot
The other US office supply chain, priced against Staples line by line.
officedepot.comRead the write-up → - Auto parts
RockAuto
The US aftermarket price floor, listed by brand tier.
rockauto.comRead the write-up →
How a custom scraper gets built
The same three steps for every site. Nothing is pre-built, which is exactly why it reaches pages a fixed integration never would.
- 1
Paste the URL
One product page, a category listing, or a whole list of links. The scraper works from the URL you hand it, so country domains and subpages need no separate integration.
- 2
You define the columns
Pick one of the ready schemas, Product Page, Product List or Page Menu, or build a Custom Schema with your own field names and types. Every run comes back with exactly those columns and nothing else. The AI fills them from the page after JavaScript has run, rather than from a saved CSS selector, so an ordinary redesign usually does not break the run.
- 3
Schedule it, then export
Run it once or daily. Every run is retrievable over REST with a stable column set, or downloadable as CSV or Excel, so downstream jobs never re-map fields.
Custom Schema: the columns are yours
Every scraper runs against a schema, and the schema is the column list. Schemas belong to your account rather than to one scraper, so the field set you settle on for a price comparison site can be reused on the next marketplace you point us at.
Start from a ready schema
- Product PageSingle product detail extraction
- Product ListMultiple products from a listing page
- Page MenuPage navigation data
- Custom SchemaDefine your own fields
Or write the fields yourself
Give the schema a name, then add a row per column: the field name, its type, a description telling the AI what to look for on the page, and whether the run should treat it as required. Three types only, so there is nothing to learn: Text, Number, Yes/No.
| Field name | Type | Description | Required |
|---|---|---|---|
| stockStatus | Text | The exact text on the page showing stock status (e.g. "In Stock", "Out of Stock", "Only 2 left"). | Yes |
| warrantyMonths | Number | Number of months of manufacturer warranty listed on the product page. | No |
| isBestSeller | Yes/No | Whether the product page shows a "Bestseller" badge or label. | No |
Four things worth knowing before you write one
The description is the instruction
It is not a comment for your colleagues. It is the sentence the AI reads to decide what on the page counts as that field. "Stock status" gets you guesswork. "The exact text on the page showing stock status, e.g. In Stock, Out of Stock, Only 2 left" gets you the string you wanted. Naming the wording you expect is the whole trick.
Required is a promise, not a filter
Marking a field required tells the run that a page without it is a problem rather than a normal result. Leave it off for anything a listing legitimately omits, like a warranty or a badge, and those cells simply come back empty instead of flagging the row.
Nothing you did not declare comes back
A saved schema is a closed contract: the run returns a list of products, each one carrying exactly your fields and no others. Two sites on the same schema produce the same columns in the same order, which is why one schema can serve every marketplace you point it at.
Saving publishes a version
Editing a schema does not rewrite history. Saving publishes a new version and every scraper on that schema picks it up on its next run, so you can widen a column list mid-project without rebuilding anything. Deleting archives the schema and scrapers already using it keep working unchanged.
What the builder will not let you do
- Every schema needs a name and at least one field.
- Field names are unique regardless of case, so price and Price cannot both exist.
- Sixteen names are reserved by the schema format itself and are rejected on save, among them type, properties, required, items, description, products, id, enum, default, format and title.
Custom scraper or data API?
Both land in the same portal, the same table and the same exports. The difference is who defines the schema and how you are charged.
Data API
- 35 ready endpoints for Amazon, Walmart, Google and YouTube
- Fixed columns we publish, with real sample rows on every page
- A published price per call, from EUR 0.15 per 1,000
- Nothing to configure: call it and rows come back
Custom scraper
- Any public website, including the ones nobody offers an endpoint for
- You choose the columns from what the page actually shows
- Charged per page from your wallet, at the tier the site needs
- Set up once in the portal, then scheduled daily
Point it at the site you actually care about
The 120 above are examples, not limits. Define your columns once in a Custom Schema, paste the URLs you want watched, and the same scraper runs against any public website on the same schedule.
Custom scrapers, answered
What people ask before pointing the scraper at a site we have not written up.
Any site we do not ship a dedicated data API for. Instead of calling a ready endpoint with fixed columns, you configure the AI scraper once against the URLs you care about, and from then on it behaves like your own endpoint: stable columns, REST retrieval, a daily schedule.