The AI Blocked Census

Livermore, California: how many business websites block AI.

Of 54 reachable business websites in Livermore in the census, 3.7% disallow at least one named major AI crawler in robots.txt.

54Livermore business websites checked and reachable
3.7%disallow at least one named major AI crawler in robots.txt (2 sites)
0.0%disallow every crawler in robots.txt (0 sites)
0.0%block the crawlers AI assistants use to answer live questions

Measured separately, by a different test: 9.3% (5 sites) blocked a request that claimed to be GPTBot. That request came from AIOInsights servers, not OpenAI's network, so a wall that checks crawler IP addresses can block it while letting the real GPTBot in. It is not added to the figures above.

Is your website on the wrong side of this? Run the free AIOInsights check: about 20 seconds, no account, and it says in plain words whether AI crawlers can read your site.

Check my website

How the census was taken

AIOInsights took every business in California that lists a website in OpenStreetMap (map data as of 2026-11-01; contributors credited under the Open Database License), kept one record per website, and checked each site between 2026-11-01 and the publish date. For each site it read /robots.txt with the same rules the free AIOInsights check uses, and loaded the homepage twice: once as a browser and once identifying as GPTBot, OpenAI's crawler. A site counts as reachable when the browser visit loads; only reachable sites are in the percentages.

This census publishes totals only. It never names a business. Any business can check its own site free, with no email, at aioinsights.com.