# CycleCalcs - robots.txt # The whole site is open to search engines and AI assistants. # AI / LLM crawlers (explicitly welcomed) User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: OAI-AdsBot User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended Allow: / # Search & ad crawlers (keep these allowed for indexing + AdSense) User-agent: Googlebot User-agent: Bingbot User-agent: AdsBot-Google User-agent: Mediapartners-Google Allow: / # Everyone else User-agent: * Allow: / Sitemap: https://www.cyclecalcs.com/sitemap.xml # Curated site map for AI assistants: https://www.cyclecalcs.com/llms.txt