How do I verify Googlebot?

Run a reverse DNS lookup on the IP. A genuine Googlebot name ends in googlebot.com or google.com. Then look up that name and make sure it points back to the same IP. This tool does both steps and also checks Google's published IP ranges. If a genuine crawler is fetching pages it shouldn't, the Robots.txt Tester shows which rule lets it in.

How do I tell a real Baiduspider from a fake one?

A real Baiduspider IP has a reverse DNS name ending in baidu.com or baidu.jp. The tool checks that and then confirms the name resolves back to the same address.

What does the verdict not a crawler mean?

The IP has no reverse DNS name belonging to a known crawler and isn't in the published lists. It may be a regular visitor, a cloud server or an unknown bot.

Why not just trust the user agent?

Anyone can send Googlebot or Baiduspider as their user agent. Only the DNS check and the published IP lists show that a request really came from the search engine's network.

How many IPs can I check at once?

10 per check without an account, 20 for signed-in members and 100 for VIP. It's free and doesn't use your daily tasks.

Verify Googlebot and Baiduspider IPs

About Verify Googlebot and Baiduspider IPs

Scrapers often pretend to be Googlebot or Baiduspider so that firewalls let them through. Use this tool when your logs show heavy crawler traffic, before you whitelist crawler IPs, or when a "Googlebot" requests pages no real crawler would. Paste the IP addresses, one per line, up to 10 at a time (20 for signed-in members, 100 for VIP), and click Verify.

For each address we look up its reverse DNS (PTR) name and check that it ends in the crawler's official domain: googlebot.com or google.com, search.msn.com for Bing, baidu.com or baidu.jp, yandex.ru, yandex.net or yandex.com, applebot.apple.com, sogou.com, 360.cn, sm.cn, petalsearch.com, naver.com, seznam.cz, duckduckgo.com or bytedance.com. Then we confirm that the name resolves back to the same IP. Google's, Bing's and OpenAI's (GPTBot) published crawler IP lists are checked too. Each address gets a verdict, genuine, fake or not a crawler, and the table exports to CSV. To look up a single PTR record, use Reverse DNS Lookup.

How to use Verify Googlebot and Baiduspider IPs

1
Copy IPs from your logs
Take the addresses whose user agent claims to be Googlebot, Baiduspider or another crawler.
2
Paste one per line
Up to 10 at a time, 20 when signed in and 100 with VIP.
3
Click Verify
Reverse DNS, forward confirmation and the published IP lists are checked.
4
Act on the verdicts
Block the fakes and keep genuine crawlers allowed.

Why use Cubfile for this

Two-way DNS check
The PTR name first, then a forward lookup back to the same IP.
13 crawler families
Google, Bing, Baidu, Yandex, Apple, Sogou, 360, Shenma, Petal, Naver, Seznam, DuckDuckGo and ByteDance.
Published IP lists
Google, Bing and OpenAI GPTBot ranges are checked as well.
Clear verdicts
Genuine, fake or not a crawler, exportable as CSV.

Related tools

SEO Broken Link CheckerCheck every link on a page and list the ones that are broken or redirected.

SEO SEO CheckerCheck a page on 40+ on-page and technical SEO points, with a fix for each problem.

SEO Indexability CheckerFind out whether a page can be indexed: status, robots, noindex and canonical in one check.

SEO Keyword Density CheckerSee which words and phrases a page repeats most, and how often.

SEO Meta Tag CheckerRead a page’s title, description, robots, canonical and social tags, with length checks.

SEO Robots.txt TesterRead a site’s robots.txt and test whether a URL is allowed for each crawler.

SEO Search Engine Spider SimulatorSee a page the way Baiduspider or Googlebot does, and whether it differs from what visitors get.

SEO AI Crawler CheckerSee which AI crawlers (GPTBot, ClaudeBot, Google-Extended…) your robots.txt lets in.