# Happy Paws Pet Grooming - robots.txt # # --------------------------------------------------------------------------- # CLASSROOM DEMONSTRATION - INTENTIONAL TEACHING ISSUE # --------------------------------------------------------------------------- # This file allows traditional search engine crawlers but blocks one # AI search crawler (OAI-SearchBot, which powers ChatGPT search results). # In class we will discuss what this means for a local business that # wants to be found in AI-powered search, and whether it should be changed. # See INSTRUCTOR_AUDIT.md (item F9) for the teaching notes. # --------------------------------------------------------------------------- # General crawlers: allowed User-agent: * Allow: / # AI search crawler: blocked (teaching example) User-agent: OAI-SearchBot Disallow: / # Note: while this demonstration site is under development every page also # carries , so nothing here # should appear in public search engines regardless of the rules above.