PILOTPILOTBOT / IDENTITYCrawler identity · Access policy
PIL.OT Beta
PIL.OT / BOT IDENTITY

A transparent identity for the PIL.OT source observer

PILOTBot observes public private-international-law sources for PIL.OT. It uses its own product name and identity page and does not impersonate a browser or another crawler.

01 / BOT IDENTITY

Machine identity

Product token
PILOTBot
Purpose
Observing public private-international-law sources for the PIL.OT publication
02 / CRAWL POLICY

Responsible access

  • Follows robots.txt and publisher access preferences.
  • Uses a reasonable request rate and honours Crawl-delay and Retry-After.
  • Does not bypass login, subscription, CAPTCHA or other access controls.
  • Prioritises public RSS, Atom, API and sitemap endpoints over HTML crawling.
  • Does not create retry storms after HTTP 403 or 429 responses.
03 / PUBLISHER CHOICE

Permission, limits or opt-out

Publishers may target PILOTBot in robots.txt. To allow, restrict or completely exclude crawling, send the relevant domain and preference to info@pil-ot.org.