USE CASE

Scrape a List of URLs: One Clean Row Per Link

You already know which pages you care about. Paste or upload the list, choose the fields you want, and Scrapewise returns one clean row per URL. Mixed shops in one file are fine. Pages that fail are retried and not charged.

THE PROBLEM

Why a List of URLs Is Harder Than It Looks

  1. 01

    Every shop puts the price somewhere else

    A list of 400 links across three shops is three different page layouts. A script written for one of them returns blanks for the other two, and the blanks look like out-of-stock rather than a broken selector.

  2. 02

    Some pages will fail, and you need to know which

    Links go stale, products get delisted, a shop rate-limits you halfway through. A run that quietly drops those rows gives you a shorter file and no reason why.

  3. 03

    Blocks start at a few hundred requests

    Opening a long list from one IP gets throttled or served a bot wall. Doing it properly means proxies, retries and a queue, which is a small project before you have a single row.

  4. 04

    You wanted a table, not a scraping stack

    The point of the list was a spreadsheet you can sort by price. Writing and maintaining the fetcher, the parser and the error handling is work that produces none of that.

1 file

Paste the links or upload a CSV; mixed shops in one list are fine

35

Ready data APIs for marketplaces and search, plus AI scrapers for any other shop

5

Free requests on every new account, no card needed

From a CSV of Links to a Clean Table in 4 Steps

Nothing here needs code. The slowest part is deciding which fields you want, and you can change that later without re-uploading the list.

  1. Upload the links

    Paste the URLs or upload a CSV or Excel column of them. One list can mix shops. Duplicate links in the file are kept once so you are not charged twice for the same page.

  2. Pick the fields

    Name the columns you want back: price, sale price, currency, title, stock, pack size, image. Scrapewise reads each page and fills them, using the page's own structured data when it publishes any and reading the rendered page when it does not.

  3. Run it, on demand or on a schedule

    Start the run yourself or set it to repeat daily or weekly. Pages that fail are retried; the ones that still fail stay visible with their error instead of disappearing from the file.

  4. Take the table

    Export CSV or Excel, read it over the REST API, or hand it to an AI agent over MCP. Group rules can clean it first: price as a number, price per kg or litre, other currencies converted to EUR.

What You Send, What You Get Back

You bring the links and the field names. You get one row per link.

You give
  • Your list of URLsrequired

    Paste them or upload a CSV or Excel column. Mixed shops in one list are fine.

    https://shop-a.example/oat-flakes-500g
  • Fields you want backrequired

    Name the columns. Anything the page shows can be a column.

    pricetitlestockpack_size
  • Your own SKU or ID per linkoptional

    A second column in the file. It is carried through to the output so the rows join back to your catalogue.

    OAT-500
  • Refresh scheduleoptional
    • Daily
    • Weekly
    • On demand

    How often the same list is scraped again.

You get

One row per URL in your file, 8 columns each

  • your_id
  • url
  • title
  • price
  • currency
  • stock
  • scraped_at
  • status

CSV or Excel export, REST API, or MCP for AI agents.

A Sample Run: 10 Links, 3 Shops, One Table

Illustrative rows in the style of a grocery list, not a customer's data. The left column is what you uploaded; the rest is what came back.

URL you uploadedTitle as scrapedPriceStatus
shop-a.example/oat-flakes-500gKaerahelbed 500 g1.29 EURScraped
shop-a.example/greek-yogurt-400gKreeka jogurt 10% 400 g2.15 EURScraped
shop-a.example/rye-bread-500gRukkileib 500 g1.65 EURScraped
shop-b.example/oat-flakes-whole-grainOat flakes whole grain 0.5 kg1.19 EURScraped
shop-b.example/oat-flakes-family-1kgOat flakes 1 kg family pack2.19 EURScraped
shop-b.example/greek-yogurt-400Greek yogurt 10%, 400 g2.09 EURScraped
shop-c.example/kaerahelbed-500gKaerahelbed 500g1.35 EURScraped
shop-c.example/jogurt-kreeka-400gJogurt, kreeka, 400 g2.29 EURScraped
shop-c.example/leib-rukki-500gRukkileib, 500 g—Out of stock, no price shown
shop-c.example/old-product-page——404 after 3 retries, not charged
RESULT

What You Get Instead of a Scraping Script

One row per link, in your order

One row per link, in your order

The output follows your file, so it joins straight back to the catalogue or sheet the links came from.

Failures you can see

Failures you can see

A link that does not resolve stays in the table with its error instead of vanishing, and a page that never loads is not charged.

The same list again tomorrow

The same list again tomorrow

Set the list to repeat daily or weekly and each run is cleaned by the same rules, so the columns stay comparable over time.

THE SHORT ANSWER

Scraping a List of URLs: The Short Answers

How do I scrape a list of URLs without coding?

How do I scrape a list of URLs without coding?

Upload the links as a CSV or paste them in, name the fields you want back, and run it. Scrapewise opens each page, fills your columns and returns a table. There is no script to write and no proxy to configure.

Can one list contain URLs from different websites?

Can one list contain URLs from different websites?

Yes. A list can mix shops and marketplaces. Each page is read on its own, so you do not need one run per site. The output is a single table with a shop column, which is what makes it comparable.

How many URLs can I scrape at once?

How many URLs can I scrape at once?

There is no fixed cap on the list size. Cost is per page scraped from your prepaid balance, so a list of 400 links costs 400 pages. Dead or blocked links are retried, kept in the table with the reason instead of dropped, and not charged.

Upload Your First List, See the Table

Start with ten links and the fields you care about. Every new account gets 5 free requests, and after that you pay as you go from a prepaid balance. Plain pages start at EUR 0.15 per 1,000 and failed pages are not charged.

FAQ

Scraping a List of URLs: FAQs

What the input looks like, what you are charged for, and what this does not do.

One URL per row in a CSV or Excel column, or pasted straight into the field. You can add a second column with your own SKU or ID and it is carried through to the output, which is what lets the result join back to your catalogue.