π€ AI Search Citation vs Model Training β’ llms.txt Standard
AI Crawler Robots.txt & llms.txt Studio
Allow AI search engines (OAI-SearchBot, PerplexityBot) to cite your site while blocking uncompensated foundation model training scrapers (CCBot, Bytespider).
π‘οΈ AI User-Agent Policy
|