# BlueFlash — Google-compatible robots.txt (industry standard) # Marketing pages are crawlable. Tutor shell + API are not for the index. # /learn/ stays crawlable so its noindex HTML/header can be seen by crawlers. User-agent: * Allow: / Allow: /api/public/library-statistics Disallow: /app.html Disallow: /app-v2.html Disallow: /api/ Disallow: /ws/ Disallow: /docs Disallow: /openapi.json Disallow: /health Disallow: /ready # Same rules for Googlebot (explicit; matching * above) User-agent: Googlebot Allow: / Allow: /api/public/library-statistics Disallow: /app.html Disallow: /app-v2.html Disallow: /api/ Disallow: /ws/ Disallow: /docs Disallow: /openapi.json Disallow: /health Disallow: /ready Sitemap: https://blueflash.in/sitemap.xml