# RFC 9309 — Robots Exclusion Protocol # Content Signals: https://contentsignals.org/ # AI crawlers: GPTBot, OAI-SearchBot, Claude-Web, Google-Extended, # Amazonbot, anthropic-ai, Bytespider, CCBot, Applebot-Extended User-Agent: * Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: GPTBot Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: OAI-SearchBot Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: Claude-Web Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: Google-Extended Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: Amazonbot Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: anthropic-ai Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: Bytespider Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: CCBot Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ User-Agent: Applebot-Extended Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / Allow: /sitemap.xml Allow: /privacy Allow: /en Allow: /docs/api.html Allow: /openapi.json Allow: /auth.md Allow: /.well-known/ Disallow: /api/ Disallow: /oauth/ Sitemap: https://www.weemotion.com/sitemap.xml Agentmap: https://www.weemotion.com/.well-known/ai-catalog.json