Is Perplexity-User blocked on your site?
Enter a domain to see whether its robots.txt lets GPTBot, OpenAI's training crawler, or any of 14 other AI crawlers read the homepage.
Ask about another crawler:
- OAI-SearchBot
- ChatGPT-User
- GPTBot
- Claude-SearchBot
- Claude-User
- ClaudeBot
- PerplexityBot
- Perplexity-User
- Google-Extended
- Applebot-Extended
- Amazonbot
- DuckAssistBot
- Meta-ExternalAgent
- CCBot
- Bytespider
About Perplexity-User
Visits pages to answer a Perplexity user's question. Perplexity says that because a user requested the fetch, it generally ignores robots.txt rules. Read the operator's documentation.
How to block or allow it
robots.txt rules are read per crawler: Perplexity-User follows a group that names it, or else the User-agent: * group. To block it everywhere:
User-agent: Perplexity-User
Disallow: /The AI crawler robots.txt generator makes these lines for any mix of crawlers. The check reads only your homepage path, robots.txt, llms.txt and a HEAD of llms-full.txt; see exactly what is fetched.