Anthropic
Claude-User
Documented Provider-maintained crawler reference.
Claude-User is Anthropic's user-triggered retrieval agent. Anthropic says its named bots honor robots.txt and that disabling Claude-User prevents retrieval in response to a user query, so its control semantics differ from ChatGPT-User and Perplexity-User.
Reference facts
- Provider
- Anthropic
- Provider identifier
- Reviewed provider reference mark
- robots.txt token
Claude-User- Purpose
- User-triggered retrieval
- Crawls pages
- Yes
- Obeys robots.txt
- Yes — documented by provider
- Search-visibility relevance
- Indirect
- Status
- active
- Information checked
Recommended policy notes
- Claude-User represents retrieval initiated by a Claude user.
- Anthropic says its named bots honor robots.txt, so Claude-User can be controlled separately from ClaudeBot and Claude-SearchBot.
Common misconceptions
- That Claude-User is a search-index crawler.
- That all user-triggered agents across providers have the same robots.txt semantics.
Limitations
- A robots.txt rule still does not authenticate a request or prove a provider attempted retrieval.
- Anthropic's published crawler IP list is time-sensitive and should be checked live when request authenticity matters.