chore(seo/geo): allow AI training crawlers in robots.txt

Switch from 'citable-not-trained' to allowing all crawlers, including AI
training crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot, …). Rationale:
being in the training corpus lets assistants recommend the editor from memory,
not only via live retrieval. Privacy is unaffected — this governs the public
landing pages only; user documents are never uploaded.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Author: chaxus

public/robots.txt

@@ -1,33 +1,14 @@
 # Online Document Editor — https://edit.chaxus.com
-# Strategy: "citable, not trained." Allow search engines and AI retrieval /
-# citation crawlers (so the app can surface in search and be cited by AI
-# assistants), but block training-only crawlers.
+# Strategy: maximize both search visibility and AI recall. Allow search engines
+# and AI crawlers alike — including AI *training* crawlers (GPTBot, ClaudeBot,
+# Google-Extended, CCBot, …) — so AI assistants both cite the editor live and
+# learn it exists, and can recommend it from memory.
+#
+# This policy governs the public marketing/landing pages only. It has no bearing
+# on user privacy: documents are edited entirely in the browser and are never
+# uploaded, so there is nothing about user files for any crawler to reach.
 
-# Default: allow everything — search engines + AI retrieval/citation bots
-# (OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-User, Bingbot, …).
 User-agent: *
 Allow: /
 
-# Block training-only crawlers.
-User-agent: GPTBot
-Disallow: /
-
-User-agent: ClaudeBot
-Disallow: /
-
-User-agent: CCBot
-Disallow: /
-
-User-agent: Google-Extended
-Disallow: /
-
-User-agent: Applebot-Extended
-Disallow: /
-
-User-agent: Bytespider
-Disallow: /
-
-User-agent: meta-externalagent
-Disallow: /
-
 Sitemap: https://edit.chaxus.com/sitemap.xml