Opt out of probing

For site operators who do not want dot.bi to fetch their home page.

What dot.bi fetches

When a visitor opens a profile, dot.bi requests the home page once (at most once a day afterwards), with the user agent Mozilla/5.0 (compatible; dotbi-probe/0.1; +https://dot.bi/opt-out), follows up to five redirects and reads at most 256 KB. It stores the status code, redirect chain, title, meta description, server header and detected technologies. It does not crawl other pages and does not execute scripts.

How to opt out

1. Add this to your robots.txt:

   User-agent: dotbi-probe
   Disallow: /

   dot.bi checks it before each fetch and will stop requesting the page.
2. Or write to [email protected] from an address at the domain; the probe is disabled within two working days.

What remains public

DNS records, registration data published through RDAP, and certificates logged in Certificate Transparency are public records provided by third parties; dot.bi shows them as any resolver, RDAP client or CT monitor would, and they are not subject to this opt-out.