PILOTPILOTBOT / IDENTITYCrawler identity · Access policy
PIL.OTv0.62.2
PIL.OT / BOT IDENTITY

A transparent identity for the PIL.OT source observer

PILOTBot observes public private-international-law sources for PIL.OT. It uses its own product name and identity page and does not impersonate a browser or another crawler.

01 / BOT IDENTITY

Machine identity

Product token
PILOTBot
Purpose
Observing public private-international-law sources for the PIL.OT publication
02 / CRAWL POLICY

Responsible access

  • Follows robots.txt and stated access preferences for general publisher sources.
  • For publicly accessible judgments, legislation and official-gazette records issued by public authorities, records the robots.txt result but may continue only on predefined official domains and public-document routes.
  • Uses a reasonable request rate and honours Crawl-delay and Retry-After.
  • Does not bypass login, subscription, CAPTCHA or other access controls.
  • Does not create retry storms after HTTP 403 or 429 responses.
03 / PUBLISHER CHOICE

Permission, limits or opt-out

Publishers may target PILOTBot in robots.txt. To allow, restrict or completely exclude crawling, send the relevant domain and preference to info@pil-ot.org. Public authorities may likewise request corrections to public-document routes or request-rate settings.