Online store scraping

Scraping global platforms: General / Department

Department and multi-category stores worldwide: catalogs, prices and stock across all departments.

37 stores in this list Category: general / Department Geography: Global market

General stores worldwide span several categories at once, and their catalogs are the most heterogeneous: electronics sits next to apparel and homeware. We bring such catalogs into one structure while preserving each department’s category attributes.

This list counts 37 stores; the leaders by domain authority: Walmart Canada, Walmart, Costco Canada. We collect data from large multi-level catalogs and niche shops alike: everything lands in one structure, so prices and assortment compare directly.

Brands you will meet across these stores include LEGO, Barbie, Samsung, Apple, Nike, Adidas. The product-to-brand mapping ships with the data: convenient for distribution control and shelf comparison.

We deliver data the way you need it: one-off price scraping or scheduled refresh, in Excel, CSV, JSON, XML, Google Sheets, REST API or straight into your database. We agree the field structure upfront and send a free sample first.

data structure

Fields we collect: General / Department

The baseline set for this category — extended to fit your task.

01
Product

title, brand, category with tree path, URL

02
Prices

current and old price, discount, promo

03
Variants

sizes, colours, versions — where applicable

04
Availability

status, stock, delivery times

05
Attributes

card attributes according to product type

06
Reviews

rating and review count

why business needs it

Jobs this scraping gets done

Cross-category monitoring

Competitor prices across several departments at once.

Assortment map

The category tree and each department’s saturation.

Promo analytics

Discount campaigns and their depth by department.

Novelty monitoring

New categories and products as they appear.

Stores in this category worldwide

Ranked by domain authority — price scraping and scheduled price monitoring are available for any platform below.

# Store Domain DR
1
Walmart Canada
walmart.ca 80
2
Walmart
walmart.com.mx 78
3
Costco Canada
costco.ca 77
4
Clas Ohlson
clasohlson.com 75
5
Falabella Perú
falabella.com.pe 73
6
Flying Tiger Copenhagen
flyingtiger.com 73
7
Falabella Colombia
falabella.com.co 72
8
Sears
sears.com.mx 72
9
Vistaprint
vistaprint.de 70
10
El Corte Inglés
elcorteingles.pt 68
11
Ripley Perú
ripley.com.pe 68
12
Costco Australia
costco.com.au 66
13
Office Depot
officedepot.com.mx 66
14
QVC
qvc.de 66
15
QVC UK
qvcuk.com 66
16
Costco Korea
costco.co.kr 60
17
Groupon
groupon.it 60
18
Kmart New Zealand
kmart.co.nz 59
19
PriceSmart
pricesmart.com 59
20
OTTO Österreich
ottoversand.at 56
21
QVC
qvc.it 53
22
vidaXL
vidaxl.se 53
23
Galaxus
galaxus.at 52
24
vidaXL
vidaxl.it 49
25
Tchibo
tchibo.cz 48
26
Tchibo
tchibo.pl 47
27
Tchibo/Eduscho
tchibo.at 47
28
vidaXL
vidaxl.be 46
29
Coppel Argentina
coppel.com.ar 43
30
Vivantis
vivantis.sk 41
31
Littlewoods Ireland
littlewoodsireland.ie 40
32
Pepco
pepco.bg 40
33
Coolshop
coolshop.nl 36
34
Veepee
veepee.de 32
35
Marks & Spencer Ireland
marksandspencer.ie 29
36
SOGO Indonesia
sogo.co.id 21
37
Central Department Store
centralindonesia.co.id 17

DR (Domain Rating) — domain authority on a 0–100 scale; it reflects link-profile strength, not sales.

top platforms

Top platforms: what gets scraped

Quick notes on the leaders of this list — any of them can be plugged into the same field structure.

Clas Ohlson scraper: what we collect

For Clas Ohlson we set up recurring collection: product, prices, variants. Cadence ranges from a one-off export to several refreshes a day.

Flying Tiger Copenhagen price monitoring

On Flying Tiger Copenhagen we track the catalog and prices — prices, variants — one-off or on a schedule. Delivered as a file, via API or straight into your database.

Falabella Colombia scraper: what we collect

For Falabella Colombia we collect variants, availability — with change history — useful for repricing and assortment control.

Vistaprint scraper: what we collect

For Vistaprint we set up recurring collection: availability, attributes, reviews. Cadence ranges from a one-off export to several refreshes a day.

El Corte Inglés scraper: what we collect

For El Corte Inglés we set up recurring collection: attributes, reviews, product. Cadence ranges from a one-off export to several refreshes a day.

how we work

From request to first delivery

01

Scope the task

We fix the stores, fields, catalog depth and refresh frequency.

02

Free sample

A data fragment in the agreed structure — before any payment.

03

Collect & validate

Full collection with completeness and consistency checks.

04

Deliver & refresh

File, API or database — refreshed on your schedule.

questions & answers

Frequently asked questions

Can we collect only part of the catalog?
Yes, collection can be limited to departments or categories — you pay only for the data you need.
How do you handle heterogeneous department attributes?
Common fields are normalised; category-specific attributes are preserved per product type — nothing is lost.
Is the feed comparable with niche stores?
Yes, the field structure matches our category feeds — department-store data compares directly with specialist stores.
request data

Need scraping of general online stores?

Describe the task — we will set up a price scraper for it, propose the field set and refresh cadence, and send a free data sample for the stores you pick.

We'll respond within one business day.