How to find AI crawlers in your server logs, and verify them
What an access log line contains, how to match the user agent tokens OpenAI, Anthropic, Perplexity, Google, Bing, Apple and Common Crawl document, how to confirm a request is genuine with published IP ranges or reverse DNS, what to measure, and what logs cannot tell you.