User-agent: * Allow: / # Block API and internal routes Allow: /_api/sitemap/ Disallow: /_api/ Disallow: /*/admin Disallow: /*/login # Explicitly allow AI crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: Anthropic Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Bytespider Allow: / User-agent: cohere-ai Allow: / User-agent: Amazonbot Allow: / User-agent: Meta-ExternalAgent Allow: / # Host Host: https://thangka.space # Sitemaps Sitemap: https://thangka.space/sitemap.xml Sitemap: https://thangka.space/sitemap-gallery.xml # AI Context — machine-readable site overview # https://thangka.space/llms.txt