pigfox.ai

South Dakota business websites and AI crawlers

387 websites measured, compared with all 562,003.

Measured by Triremes between 4 November 2026 and 8 November 2026 across 562,003 business websites; groups under 100 sites are not shown.

Share of sites whose robots.txt blocks each AI crawler

GPTBot3.1% ClaudeBot4.1% PerplexityBot0.3% OAI-SearchBot1.3% ChatGPT-User0.3% Google-Extended2.8% Applebot-Extended2.6% CCBot2.6% Bytespider2.8% Meta-ExternalAgent2.6%

Share of sites with each AI search signal

No robots.txt14.2% Has llms.txt9.8% Organization JSON-LD15.8% WebSite JSON-LD23.8% Title 30 to 60 characters30%

The numbers

MeasureSouth DakotaAll sites
Blocks GPTBot3.1%7.8%
Blocks ClaudeBot4.1%7.5%
Blocks PerplexityBot0.3%0.4%
Blocks OAI-SearchBot1.3%0.3%
Blocks ChatGPT-User0.3%0.5%
Blocks Google-Extended2.8%7.3%
Blocks Applebot-Extended2.6%7.3%
Blocks CCBot2.6%7.6%
Blocks Bytespider2.8%7.8%
Blocks Meta-ExternalAgent2.6%7.4%
No robots.txt14.2%18%
Has llms.txt9.8%6.5%
Organization JSON-LD15.8%11.4%
WebSite JSON-LD23.8%13.8%
Title 30 to 60 characters30%29.9%

By industry

By state or territory

About these numbers

Each figure is the share of measured sites in the group. Measured by Triremes between 4 November 2026 and 8 November 2026 across 562,003 business websites; groups under 100 sites are not shown. Lists are in alphabetical order. These figures describe what sites do, not what they should do.

Data: Triremes. Check your own site with the AI search readiness checker.