AI crawler directory / Perplexity-User
Perplexity-User
Documented Provider-maintained crawler reference.
Reference facts
- Provider
- Perplexity
- robots.txt token
Perplexity-User- Purpose
- User-triggered retrieval
- Crawls pages
- Yes
- Obeys robots.txt
- No
- Search-visibility relevance
- Indirect
- Status
- active
- Last verified
- Revision
- 1.0
Recommended policy notes
- Perplexity documents this token for user-initiated fetches.
- The provider states this fetcher generally ignores robots.txt.
Common misconceptions
- That Perplexity-User and PerplexityBot have identical policy semantics.