Our robot

ConformRadarBot

Our robot does not crawl the web on its own. It reads a site only when someone requests a check on conformradar.com.

Identification

ConformRadarBot/0.1 (+https://conformradar.com/robot)

How it behaves

• it reads the robots.txt file first and respects its rules;
• one request per second at most, 14 pages at most per check;
• 2.5 MB at most per page, images and scripts are not downloaded;
• public pages only: no forms submitted, no logins, nothing added to the basket;
• the same shop is not read more than once every half hour: a recent report is reused.

Blocking the robot

Add these lines to your site's robots.txt file. Later checks will stop before reading any page.

User-agent: ConformRadarBot
Disallow: /

Contact

To report unusual behaviour or have a report removed: contact@twaino.com.