User-agent: *
Allow: /
Disallow: /dashboard/
Disallow: /api/
Disallow: /report/verify
Disallow: /report/oauth-complete
Disallow: /500
Disallow: /network-error

# 1 Nov 2026: the sign-in, sign-up, password, onboarding and settings pages are no
# longer disallowed. They are served with <meta name="robots" content="noindex"> and an
# X-Robots-Tag (route-heads.ts isNoindexRoute), and a crawler that is not allowed to
# fetch a page never sees its noindex, so a disallowed URL could still be indexed bare.

# BUG-716: ONE canonical sitemap. /sitemap.xml is now a sitemap index fanning
# out to /sitemap-app.xml (web app) + /sitemap-0.xml (the pSEO earning surface).
# The old second line advertised Astro's own /sitemap-index.xml, which was never
# submitted and only ever described half the site — two rival sitemaps naming
# overlapping URL sets is exactly the split this bug existed to remove.
Sitemap: https://rivalize.ai/sitemap.xml