sitemap.xml, robots.txt and llms.txt
Publish a sitemap, robots.txt and llms.txt, and choose exactly which pages search engines and AI crawlers see.
You wrote a blog and landing pages you wanted found. Nothing told a search engine or an AI crawler that they existed.
The enemy is pages that exist but that nobody can discover.
Brands can now publish sitemap.xml, robots.txt and llms.txt. Turn each file on under Settings, SEO, then tick the pages you want listed. Checkout, upsell, draft and password-protected pages never appear, and a noindex page stays out even if it is ticked. The settings screen shows every page that was left out, and why.
Try it: enable the sitemap, tick one page, and open /sitemap.xml on your domain.
Documentation