PricanaBot
PricanaBot collects prices from the public pages of online shops for Pricana’s datasets. Here is how it behaves, and how you can stop it.
How it identifies itself
Every request carries this User-Agent. Its name for robots.txt is PricanaBot.
Mozilla/5.0 (compatible; PricanaBot/1.0; +https://pricana.io/bot; bot@pricana.io)The rules it follows
- robots.txt (RFC 9309), including Crawl-delay, Request-rate and Visit-time. A site that asks for more than 60 seconds between requests isn’t read at all. If robots.txt can’t be read, nothing is fetched. It is read again at least every 6 hours.
- Reservations against text and data mining (§ 44b UrhG): /.well-known/tdmrep.json (TDMRep), ai.txt, the tdm-reservation header and meta tag. A reservation stops everything at that site. They are read again at least every 24 hours.
- At most one request per 1.5 seconds per site. No logins, no solving of captchas, no way around bot protection: a bot wall stops the site.
- Product pages only on the same site; links to other shops are never followed.
- Only what a price needs: price, title, link, GTIN/EAN, brand, availability, category. No descriptions, no reviews, no images (only their address).
What happens with the data
Pricana delivers datasets to businesses. Every source is reviewed in a source register (robots.txt, reservations, terms, database rights) before its data reaches a customer; price comparison sites are never resold.
How to opt out
Three ways, each honoured without exception:
- robots.txt: takes effect at the next read (at the latest after 6 hours).
- A TDM reservation (tdmrep.json, ai.txt, header or meta tag): at the latest after 24 hours.
- The form below, or an email to the bot address: we confirm your address and carry it out within 72 hours, at once if your address belongs to the site’s domain.
User-agent: PricanaBot
Disallow: /An opt-out means: PricanaBot fetches nothing more from the site, its data is no longer given to customers, we delete the company details of the shop that we found on price comparison sites, and on request everything collected from the site.
Or by email: bot@pricana.io