A website can look fine and still not work.
After he locks up the shop, Dave pulls up his own website on his phone. Sorrel Creek Auto: four bays, booked most of the week. The site looks the way it always has.
But a site can look fine and still have problems nobody sees. A setting flips. A page moves. The hours stop matching. Nothing beeps, so nobody notices.
Two lines tell ChatGPT search to stay out.
User-agent: *Disallow: /wp-admin/ User-agent: OAI-SearchBotDisallow: / These two linesSitemap: https://sorrelcreekauto.example/sitemap.xml yourbusiness.com/robots.txt into your browser.An email from me lands in Dave's inbox: one thing my checker found on his site, and how to check it himself.
Most websites have a small file called robots.txt. It tells search engines and AI assistants what they may read. Sorrel Creek's has two lines telling OpenAI's search crawler to keep out. So when a driver asks ChatGPT to search for a mechanic nearby, Sorrel Creek can't be in that answer.
Nobody remembers adding them. How they got there doesn't matter. That they're there does.
OpenAI's own docs:
Sites that are opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though can still appear as navigational links.
One site. Four quiet problems.
Free site check
sorrelcreekauto.example
-
Booking button goes nowhere
Tap Book now and you land on a page that isn't there.
-
Call button dials a short number
Tap Call and your phone offers a number with digits missing.
-
ChatGPT search blocked
Two lines in robots.txt tell OpenAI's search crawler to stay out.
-
Sitemap points at another business
The file that lists your pages for Google names a different company's site.
Dave replies yes, and I send him a private link to his new homepage, with every finding listed and fixed. Four problems. Not one of them shows when you glance at the homepage.