Data Collector
The Data Collector is Shalion's scraping / extraction engine. Ecometry decides what to measure; the Data Collector decides how it is collected from the web — projects define the scraper, orders schedule the work per store, and each run becomes an execution made of many tasks.
Projects
Extraction projects — code, output schema, template, tags and proxy account.
Templates
Reusable project templates with environment variables and allowed proxies.
Output schemas
The shape of the extracted data — fields and their data types.
Orders
What to extract from which store, on which schedule and delivery method.
Executions
Each run of an order — status, task summary, errors and proxy usage.
Tasks
The individual scraping units inside an execution, with status and errors.
Proxies
Proxy providers and accounts used to route extraction traffic.
Error indicators
Regex rules that classify task failures and drive automatic re-execution.