About my site checker's visits

If you saw BetterWebGuyCheck in your logs, that was my site checker at betterwebguy.com/check. It visits a site when someone types that site's address into the checker and asks for a check, or, with a single quick request, to see whether a link or photo on a site it's checking still opens.

What it reads: your robots.txt first, then your homepage, one contact page, your sitemap, the links and photos on your homepage, and your public DNS and domain registry records. It loads your homepage once in a phone browser to take a picture, the way one visitor would, and sometimes your contact page too. It never logs in, fills in or sends a form, or changes anything.

How much: about 30 to 60 requests per check, never more than 3 at a time, plus one phone browser visit that loads your page the way a visitor's phone does. The same site gets at most 6 fresh checks a day, and repeat requests within 24 hours get the saved result.

To ask it to stay away: add these two lines to your robots.txt

User-agent: BetterWebGuyCheck
Disallow: /

or email matt@betterwebguy.com from an address at your domain, and I'll add your domain to the checker's do-not-check list.

It identifies itself as:

Mozilla/5.0 (iPhone; CPU iPhone OS 18_6 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/18.6 Mobile/15E148 Safari/604.1 BetterWebGuyCheck/1.0 (+https://betterwebguy.com/bot)

Check my site