User-agent: * Allow: / # Admin panel & internal APIs Disallow: /admin-panel/ Disallow: /api/ # Transactional pages Disallow: /*/checkout/ # Sign-in and sign-up pages are intentionally NOT disallowed: they carry a # noindex meta, and a crawler that is not allowed to fetch them never reads # it (Search Console kept reporting them as "blocked by robots.txt"). # Private per-user app screen Disallow: /*/settings # App deep-link redirector shells (JS redirects, nothing to crawl) Disallow: /*/open-app Disallow: /*/add-recipe Disallow: /*/add-album Disallow: /*/planner Disallow: /*/tutorial # CookNest Books: /{locale}/books is the public page and must stay crawlable; # the screens under it are private (the sign-in page carries a noindex meta). Disallow: /*/books/shelf Disallow: /*/books/edit/ Disallow: /*/books/preview/ Disallow: /*/books/cart Disallow: /*/books/order-confirmed Disallow: /*/books/account # Creators portal (the public /creators marketing page stays allowed; # /creators/login only redirects to the Studio sign-in, which is noindex) Disallow: /*/creators/dashboard # Private recipe / album / collab pages are intentionally NOT disallowed: they # carry a noindex meta (kept out of search) yet must stay crawlable so link # unfurlers (WhatsApp, iMessage, Slack, etc.) can read their OpenGraph tags. # Language models: /llms.txt is a Markdown map of this site, generated from the # same route list as the sitemap. There is no robots directive for it, so this # line is a signpost for anyone reading the file. Sitemap: https://cooknest.app/sitemap.xml