# Release version. # Policy: search and answer crawlers are welcome, because AI answers and ChatGPT ads need an indexed page. # Nothing private is on this site, so training crawlers are allowed too. HD decides (docs/funnel-plan.md, D11). # Search and answer crawlers (they bring the page into answers) User-agent: OAI-SearchBot User-agent: Bingbot User-agent: Googlebot User-agent: PerplexityBot User-agent: Claude-SearchBot Allow: / # Checks pages that are submitted as ChatGPT ads. Blocking it can get an ad rejected. User-agent: OAI-AdsBot Allow: / # Model training. To opt out, change Allow to Disallow for these. User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended Allow: / # Note: ChatGPT-User fetches a page when a person asks about it. OpenAI says robots.txt rules may not apply to it. User-agent: * Allow: / Sitemap: https://attendit.at/sitemap.xml