Scraping general online stores in the United Kingdom — price & assortment monitoring
General retail scraping in the United Kingdom: from electronics to groceries — one data structure.
General stores in the United Kingdom span several categories at once, and their catalogs are the most heterogeneous: electronics sits next to apparel and homeware. We bring such catalogs into one structure while preserving each department’s category attributes.
This list counts 16 stores; the leaders by domain authority: John Lewis, Marks & Spencer, Selfridges. We collect data from large multi-level catalogs and niche shops alike: everything lands in one structure, so prices and assortment compare directly.
Brands you will meet across these stores include Dyson, adidas, Nike, Apple, Samsung, Sony. The product-to-brand mapping ships with the data: convenient for distribution control and shelf comparison.
We deliver data the way you need it: one-off price scraping or scheduled refresh, in Excel, CSV, JSON, XML, Google Sheets, REST API or straight into your database. We agree the field structure upfront and send a free sample first.
Fields we collect: General / Department
The baseline set for this category — extended to fit your task.
title, brand, category with tree path, URL
current and old price, discount, promo
sizes, colours, versions — where applicable
status, stock, delivery times
card attributes according to product type
rating and review count
Jobs this scraping gets done
Competitor prices across several departments at once.
The category tree and each department’s saturation.
Discount campaigns and their depth by department.
New categories and products as they appear.
Stores in this category in the United Kingdom
Ranked by domain authority — price scraping and scheduled price monitoring are available for any platform below.
| # | Store | DR |
|---|---|---|
| 1 | John Lewis |
82 |
| 2 | Marks & Spencer |
82 |
| 3 | Selfridges |
81 |
| 4 | Harrods |
80 |
| 5 | Argos |
79 |
| 6 | Very |
75 |
| 7 | Debenhams |
74 |
| 8 | House of Fraser |
73 |
| 9 | Moonpig |
71 |
| 10 | The Range |
71 |
| 11 | Wilko |
70 |
| 12 | Interflora |
67 |
| 13 | QVC UK |
66 |
| 14 | Studio |
51 |
| 15 | Freemans |
49 |
| 16 | TJ Hughes |
33 |
DR (Domain Rating) — domain authority on a 0–100 scale; it reflects link-profile strength, not sales.
Top platforms: what gets scraped
Quick notes on the leaders of this list — any of them can be plugged into the same field structure.
On John Lewis we track the catalog and prices — product, prices — one-off or on a schedule. Delivered as a file, via API or straight into your database.
For Marks & Spencer we set up recurring collection: prices, variants, availability. Cadence ranges from a one-off export to several refreshes a day.
On Selfridges we track the catalog and prices — variants, availability — one-off or on a schedule. Delivered as a file, via API or straight into your database.
For Harrods we set up recurring collection: availability, attributes, reviews. Cadence ranges from a one-off export to several refreshes a day.
On Argos we track the catalog and prices — attributes, reviews — one-off or on a schedule. Delivered as a file, via API or straight into your database.
From request to first delivery
Request & brief
Pick platforms from the list, define fields and cadence.
Data sample
We show the structure on a real catalog fragment, free.
Full collection
Entire catalogs, with quality and dedup control.
Data delivery
Excel, CSV, JSON, API or your DBMS — one-off or scheduled.
Frequently asked questions
Can we collect only part of the catalog?
How do you handle heterogeneous department attributes?
Is the feed comparable with niche stores?
Other categories: United Kingdom
Store scraping for other categories in the same geography.