USE CASE

Scrape a List of URLs: One Clean Row Per Link

You already know which pages you care about. Upload the list, choose the fields you want, and Scrapewise returns one clean row per URL. One file can hold links from several shops. Pages that fail are retried and not charged. Upload your own catalogue as well, and the competitor prices come back matched to your products.

THE PROBLEM

Why a List of URLs Is Harder Than It Looks

  1. 01

    Every shop puts the price somewhere else

    A list of 400 links across three shops is three different page layouts. A script written for one of them returns blanks for the other two, and the blanks look like out-of-stock rather than a broken selector.

  2. 02

    Some pages will fail, and you need to know which

    Links go stale, products get delisted, a shop rate-limits you halfway through. A run that quietly drops those rows gives you a shorter file and no reason why.

  3. 03

    Blocks start at a few hundred requests

    Opening a long list from one IP gets throttled or served a bot wall. Doing it properly means proxies, retries and a queue, which is a small project before you have a single row.

  4. 04

    You wanted a table, not a scraping stack

    The point of the list was a spreadsheet you can sort by price. Writing and maintaining the fetcher, the parser and the error handling is work that produces none of that.

1 file

Upload a CSV, Excel or JSON Lines file; one file can hold links from several shops

35

Ready data APIs for marketplaces and search, plus AI scrapers for any other shop

5

Free requests on every new account, no card needed

From a CSV of Links to a Clean Table in 4 Steps

Nothing here needs code. The slowest part is deciding which fields you want, and you can change that later without re-uploading the list.

  1. Upload the links

    Upload a CSV, Excel or JSON Lines file, or send the list over the API. One file can hold links from several shops. Scrapewise sets up one scraper per shop in one group and fills each link list from your file. Duplicate links in the file are kept once so you are not charged twice for the same page.

  2. Pick the fields

    Name the columns you want back: price, sale price, currency, title, stock, pack size, image. Scrapewise reads each page and fills them, using the page's own structured data when it publishes any and reading the rendered page when it does not.

  3. Run it, on demand or on a schedule

    Start the run yourself or set it to repeat daily or weekly. Pages that fail are retried; the ones that still fail stay visible with their error instead of disappearing from the file.

  4. Take the table

    Export CSV or Excel, read it over the REST API, or hand it to an AI agent over MCP. Group rules can clean it first: price as a number, price per kg or litre, other currencies converted to EUR.

What You Send, What You Get Back

You bring the links and the field names. You get one row per link.

You give
  • Your list of URLsrequired

    Upload a CSV, Excel or JSON Lines file, or send the list over the API. One file can hold links from several shops.

    https://shop-a.example/oat-flakes-500g
  • Fields you want backrequired

    Name the columns. Anything the page shows can be a column.

    pricetitlestockpack_size
  • Your own SKU or ID per linkoptional

    Put your own SKU or ID in the title next to each link. It comes back on the row, so the result joins to your catalogue.

    OAT-500
  • Refresh scheduleoptional
    • Daily
    • Weekly
    • On demand

    How often the same list is scraped again.

You get

One row per URL in your file, 8 columns each

  • link_title
  • url
  • title
  • price
  • currency
  • stock
  • scraped_at
  • status

CSV or Excel export, REST API, or MCP for AI agents.

A Sample Run: 10 Links, 3 Shops, One Table

Illustrative rows in the style of a grocery list, not a customer's data. The left column is what you uploaded; the rest is what came back.

URL you uploadedTitle as scrapedPriceStatus
shop-a.example/oat-flakes-500gKaerahelbed 500 g1.29 EURScraped
shop-a.example/greek-yogurt-400gKreeka jogurt 10% 400 g2.15 EURScraped
shop-a.example/rye-bread-500gRukkileib 500 g1.65 EURScraped
shop-b.example/oat-flakes-whole-grainOat flakes whole grain 0.5 kg1.19 EURScraped
shop-b.example/oat-flakes-family-1kgOat flakes 1 kg family pack2.19 EURScraped
shop-b.example/greek-yogurt-400Greek yogurt 10%, 400 g2.09 EURScraped
shop-c.example/kaerahelbed-500gKaerahelbed 500g1.35 EURScraped
shop-c.example/jogurt-kreeka-400gJogurt, kreeka, 400 g2.29 EURScraped
shop-c.example/leib-rukki-500gRukkileib, 500 g—Out of stock, no price shown
shop-c.example/old-product-page——404 after 3 retries, not charged
RESULT

What You Get Instead of a Scraping Script

One row per link, with your title

One row per link, with your title

The URL and your title are on every row, so the result joins back to your file.

Failures you can see

Failures you can see

A link that does not resolve stays in the table with its error instead of vanishing, and a page that never loads is not charged.

The same list again tomorrow

The same list again tomorrow

Set the list to repeat daily or weekly and each run is cleaned by the same rules, so the columns stay comparable over time.

THE SHORT ANSWER

Scraping a List of URLs: The Short Answers

How do I scrape a list of URLs without coding?

How do I scrape a list of URLs without coding?

Upload the links as a CSV, Excel or JSON Lines file, name the fields you want back, and run it. Scrapewise opens each page, fills your columns and returns a table. There is no script to write and no proxy to configure.

Can one list contain URLs from different websites?

Can one list contain URLs from different websites?

Yes. One file can hold links from several shops. Scrapewise sets up one scraper per shop in one group and fills each link list from your file. The group gives you one table.

How many URLs can I scrape at once?

How many URLs can I scrape at once?

Up to 5,000 links in one API or MCP call, and up to 100,000 links in one JSON Lines upload. A file of links can be up to 200 MB as CSV or JSON Lines (Excel up to 36 MB). Cost is per page scraped from your prepaid balance, so a list of 400 links costs 400 pages. Dead or blocked links are retried, kept in the table with the reason instead of dropped, and not charged.

Upload Your First List, See the Table

Start with ten links and the fields you care about. Every new account gets 5 free requests, and after that you pay as you go from a prepaid balance. Plain pages start at EUR 0.15 per 1,000 and failed pages are not charged.

FAQ

Scraping a List of URLs: FAQs

What the input looks like, what you are charged for, and what this does not do.

One URL per row in a CSV or Excel file, or one JSON object per line in a JSON Lines file. Put your own SKU or ID in the title next to each link. It comes back on the row, so the result joins to your catalogue.