be preferred

Test case

We caught a fake Googlebot on a client's site. Here's how — and why your traffic logs lie to you.

While monitoring a client site's visitor log, we spotted what looked like great news: Googlebot, crawling page after page. Then we checked where it actually came from. Real Googlebot visits from Google's own network — its addresses are published and verifiable. This "Googlebot" came from a rented server that had nothing to do with Google. A scraper, wearing a costume.

This matters because businesses make real decisions on bot traffic. "Google is crawling us daily" feels like progress; owners see it in an analytics plugin and relax. But the name a visitor gives is just a text label anyone can type. The only trustworthy identification is the network the visit came from — which most analytics tools never check.

So our crawler log verifies every bot visit at the network level before recording it. When our dashboard says Google or an AI assistant's crawler read your site, that's confirmed fact, not a claimed name. And the AI crawlers matter most now: seeing GPTBot or Claude's crawler in your verified log is the earliest signal that your content is entering the material assistants learn and quote from.

The takeaway: before celebrating any line in your traffic report, ask how it was verified. In this field, unverified good news is the most expensive kind.

← All insights