Our robot

ConformRadarBot

Our robot does not crawl the web on its own. It reads a site only when someone requests a check on conformradar.com.

Identification

ConformRadarBot/0.1 (+https://conformradar.com/robot)

How it behaves

• it reads the robots.txt file first and respects its rules;
• one request per second at most, 20 pages at most per check;
• 8 MB at most per page, images and scripts are not downloaded;
• public pages only: no forms submitted, no logins, nothing added to the basket;
• the same shop is not read more than once every half hour: a recent report is reused.

Blocking the robot

Add these lines to your site's robots.txt file. Later checks will stop before reading any page.

User-agent: ConformRadarBot
Disallow: /

Allowing the robot through a firewall

Some bot protections (Cloudflare, for example) block ConformRadarBot before it even reads robots.txt. To check your shop, temporarily add a rule that lets through requests whose user agent contains ConformRadarBot, run the check, then remove the rule.

Contact

To report unusual behaviour or have a report removed: contact@conformradar.com.