Anthropic updated its crawler documentation to list separate Claude bots for training, search indexing, and user requests, ...