# Happy Paws Pet Grooming: the FIXED robots.txt (teaching example) # # robots.txt only works at the root of a domain. This copy lives at /after/robots.txt so the class can compare it # with the live /robots.txt, which blocks OAI-SearchBot on purpose (audit F9). On the real site, this file would # replace that one. # # Decision: a local business that wants to be recommended by AI assistants lets the AI SEARCH crawlers in. # Whether to also allow the AI TRAINING crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot) is a business choice. # Here we allow them, because more exposure helps a small business more than it hurts it. Write the decision down either way. User-agent: * Allow: / # AI search and answer crawlers: explicitly allowed User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / Sitemap: https://happy-paws-grooming-demo.vercel.app/after/sitemap.xml