NogaBot

Crawler operated by Noga (nogahq.com), Stockholm, Sweden. Last updated 10 November 2026.

Who we are and why we crawl

Noga builds tools that help online stores show prices and consumer information correctly under EU and Nordic rules. NogaBot visits public pages of online stores to measure how commonly certain problems occur, such as a missing or incorrect “lowest price in the last 30 days” line on a reduced price. We publish aggregate findings and may tell a store owner about a problem we found on their own store, with the evidence attached.

User agent

NogaBot/1.0 (+https://nogahq.com/bot)

Every request, including pages rendered in a browser, carries this user agent. We never disguise the crawler as a regular browser.

What we fetch

• /robots.txt, before anything else on the host.
• Public storefront pages: home, product, collection and policy pages.
• Public storefront endpoints such as /products.json and /meta.json, where robots.txt allows them.
• We never log in, never add items to a cart, never start a checkout, and never submit forms.

How gently we crawl

• At most 1 request per second per host for ordinary fetches.
• At most 1 page render per second per host; images, video and other media are blocked when we render.
• We follow Retry-After and back off on errors and rate limits.
• robots.txt is followed as specified in RFC 9309 and cached for up to 24 hours.

Personal data

NogaBot does not collect or store personal data. We keep only what is needed to show a finding: the page address, the time, the visible price text and prices, and a screenshot of the relevant part of the page.

How to opt out

Either block NogaBot in your robots.txt:

User-agent: NogaBot
Disallow: /

or email hello@nogahq.com with your domain. We add it to our exclusion list within 24 hours and do not crawl it again.

Contact

Questions or problems: hello@nogahq.com.

På svenska: NogaBot är Nogas webbsökare. Den besöker publika sidor i webbutiker för att mäta hur vanliga vissa fel i prisinformation är. Den följer robots.txt, gör högst en förfrågan och en sidrendering per sekund och värd, loggar aldrig in och sparar inga personuppgifter. Vill du att vi inte besöker din butik: blockera NogaBot i robots.txt eller mejla hello@nogahq.com.