Anthropic

Claude-User

Documented Provider-maintained crawler reference.

Reference facts

Provider
Anthropic
Provider identifier
Reviewed provider reference mark
robots.txt token
Claude-User
Purpose
User-triggered retrieval
Crawls pages
Yes
Obeys robots.txt
Yes — documented by provider
Search-visibility relevance
Indirect
Status
active
Information checked

Recommended policy notes

Common misconceptions

Official source

Anthropic documentation →