
Perplexity shows numbered source links next to its answers, so it can send real visits to the sites it reads. Two user agents decide whether it can read yours. PerplexityBot crawls the web ahead of time for Perplexity search. Perplexity-User fetches a page live when someone’s question needs it. They follow different rules, and treating them as one bot is the most common mistake in Perplexity crawler policy.
PerplexityBot is Perplexity’s search crawler. Its documented job is to surface and link websites in Perplexity search results. Perplexity states that it is not used to crawl content for AI foundation models.
The full user agent string, as listed in Perplexity’s crawler documentation, is:
In firewall and log rules, match on the PerplexityBot token rather than the whole string. Version numbers in user agents can change.
Perplexity-User supports user actions inside Perplexity. When someone asks a question that needs a specific page, it may visit that page and link it in the answer.
Perplexity says it is not used for web crawling or to collect training data. Its string follows the same pattern:
| PerplexityBot | Perplexity-User | |
|---|---|---|
| Role | Crawls ahead of time for Perplexity search | Fetches a page when a user’s question needs it |
| Trigger | Automatic | A user request |
| robots.txt | Controls it; changes can take up to 24 hours | Generally ignored, per Perplexity |
| Model training | Not used for it, per Perplexity | Not used for it, per Perplexity |
| Published IP list | perplexitybot.json | perplexity-user.json |
Address the bot by its token in your robots.txt file. This keeps PerplexityBot out of one private section and leaves the rest open:
To block it everywhere, use Disallow: / on its own. Perplexity says it can take up to 24 hours for its systems to reflect robots.txt changes.
Watch the fallback rule as well. Under RFC 9309, a crawler with no group of its own follows the User-agent: * group. A blanket Disallow: / under * blocks PerplexityBot too, unless you give it a named group.
Generally, no. Perplexity’s documentation says that because a user requested the fetch, Perplexity-User generally ignores robots.txt rules.
A User-agent: Perplexity-User group can still record your preference. Don’t treat it as a lock. To keep content away from the fetcher, use real access controls: a login, firewall rules or bot management at your CDN.
There’s a trade-off. Blocking the fetcher also stops Perplexity from reading your page when a user asks about it directly. The answer then gets built from what other sites say about you.
Anyone can put "PerplexityBot" in a user agent. Before you allow or block by name, match the request IP against Perplexity’s published lists:
If you run a web application firewall, Perplexity recommends matching both the user agent and these IP ranges. Refresh the rules from the JSON files regularly, since the ranges change.
A quick first pass on a server log looks like this:
It lists each requesting IP with its hit count, ready to compare with the published ranges.
Verification has a second purpose. In August 2025, Cloudflare reported undeclared Perplexity crawling with a generic browser user agent after sites blocked its bots. Perplexity disputed the findings. Logs checked against published IPs let you judge your own site on evidence.
| Provider | Search crawler | Training crawler | User-triggered fetcher |
|---|---|---|---|
| Perplexity | PerplexityBot | None documented | Perplexity-User |
| OpenAI | OAI-SearchBot | GPTBot | ChatGPT-User |
| Anthropic | Claude-SearchBot | ClaudeBot | Claude-User |
The pattern holds across providers: search, training and live fetching are separate decisions with separate tokens. For the other two, see our pages on OAI-SearchBot and ClaudeBot and Claude-SearchBot.
Access gets you in the door. Nothing more.
Every step after the second depends on relevance and on the other sources competing for the same question. A page can pass every technical check and still lose the citation to a clearer, more specific source. The only way to know whether Perplexity search cites you is to track real answers.
For most brands that want to be recommended, yes. Both agents feed answers that link back to their sources, and Perplexity says neither is used for model training.
* group.Steps two to five are the core of AI crawler accessibility. Our checklist on checking if AI crawlers can access your website covers them for every major bot.
Ansvisor’s Site Audit checks your robots.txt and AI bot access, so a stray rule doesn’t lock PerplexityBot out. The Perplexity visibility tracker then shows whether Perplexity names and cites you across your prompts. You also see which of your pages it cites and which competitors it picks instead.
Perplexity tracking is included from the Growth plan, next to ChatGPT, Gemini, Microsoft Copilot, Google AI Overviews and Google AI Mode. Start a 14-day free trial to see your Perplexity citations.
Each prompt you win brings more mentions, more citations and more buyers. Ansvisor keeps finding the next one.
PerplexityBot is Perplexity’s search crawler. Perplexity says it is designed to surface and link websites in Perplexity search results and is not used to crawl content for AI foundation models. You control it with robots.txt.
Perplexity-User is a fetcher that visits a page when a Perplexity user asks a question that needs it, then links the page in the answer. Perplexity says it is not used for web crawling or for training AI foundation models.
Generally not. Perplexity’s documentation says that because a user requested the fetch, Perplexity-User generally ignores robots.txt rules. To keep content away from it, use a login or firewall rules, knowing that this also stops Perplexity from reading the page for users.
Add a “User-agent: PerplexityBot” group to robots.txt with “Disallow: /” to block it or “Allow: /” to permit it. Perplexity says changes can take up to 24 hours. If you use a firewall, allow both the user agent and Perplexity’s published IP ranges.
No. Access only makes your pages eligible to be found. Whether Perplexity cites a page depends on the question and on the other sources available. Treat crawler access as a prerequisite and measure citations directly with a tracker.
See how AI answers describe your brand, find out why competitors get picked, and close the gaps with AI agents that work alongside your team.
14-day free trial or 50% off your first month with code SAVE50.
Continue exploring key AI visibility concepts.
Measure and improve how often your brand appears in AI-generated answers.
Learn more →Strategies for increasing visibility in answer engines and AI summaries.
Learn more →Optimizing content for AI-powered discovery experiences.
Learn more →Understand how OpenAI retrieves and synthesizes information.
Learn more →AI-generated summaries that appear directly in Google Search.
Learn more →Explore how Perplexity cites and presents sources.
Learn more →References and sources used by AI systems to support answers.
Learn more →Measure the quality and influence of cited sources.
Learn more →How easily AI systems can discover and reuse your content.
Learn more →New terms are added regularly.
Help us improve the page or suggest a new term →
Co-founder at Ansvisor
Cihan Geyik is the co-founder of Ansvisor, an open-source AI Visibility platform for AI Search. With more than 15 years of experience in digital marketing and growth, he writes about AI visibility, AI search, AEO, GEO, citations, and answer engines. He focuses on helping brands understand and improve their presence across ChatGPT, Gemini, Google AI Overviews, Bing AI Mode and other AI answer engines.
Add Ansvisor as a preferred source and Google will show you more of our AI search, AEO and GEO guides.
© 2026 Ansvisor. All rights reserved. Ansvisor is an open-source AI Search Execution Platform for AI Visibility. Ansvisor is a brand owned and operated by Empler AI Inc.
The open-source AI Search Execution Platform. Track how AI answers talk about your brand and act on it.
Open source · MIT license© 2026 Ansvisor, a brand of Empler AI Inc. · 1401 PE Ave. Unit 105, Wilmington, DE 19806, United States
Cookie preferences
We use cookies to keep the site working and, with your OK, to measure traffic and improve our marketing. Read our Cookies & Tracking policy.