pigfox.ai

Professional Organizations: websites and AI crawlers

453 websites measured, compared with all 562,003.

Measured by Triremes between 4 November 2026 and 8 November 2026 across 562,003 business websites; groups under 100 sites are not shown.

Share of sites whose robots.txt blocks each AI crawler

GPTBot5.3% ClaudeBot5.1% PerplexityBot0.9% OAI-SearchBot0.4% ChatGPT-User0.4% Google-Extended4.9% Applebot-Extended4.6% CCBot5.1% Bytespider4.9% Meta-ExternalAgent4.9%

Share of sites with each AI search signal

No robots.txt10.4% Has llms.txt5.7% Organization JSON-LD11.7% WebSite JSON-LD13.9% Title 30 to 60 characters31.3%

The numbers

MeasureProfessional OrganizationsAll sites
Blocks GPTBot5.3%7.8%
Blocks ClaudeBot5.1%7.5%
Blocks PerplexityBot0.9%0.4%
Blocks OAI-SearchBot0.4%0.3%
Blocks ChatGPT-User0.4%0.5%
Blocks Google-Extended4.9%7.3%
Blocks Applebot-Extended4.6%7.3%
Blocks CCBot5.1%7.6%
Blocks Bytespider4.9%7.8%
Blocks Meta-ExternalAgent4.9%7.4%
No robots.txt10.4%18%
Has llms.txt5.7%6.5%
Organization JSON-LD11.7%11.4%
WebSite JSON-LD13.9%13.8%
Title 30 to 60 characters31.3%29.9%

By industry

By state or territory

About these numbers

Each figure is the share of measured sites in the group. Measured by Triremes between 4 November 2026 and 8 November 2026 across 562,003 business websites; groups under 100 sites are not shown. Lists are in alphabetical order. These figures describe what sites do, not what they should do.

Data: Triremes. Check your own site with the AI search readiness checker.