Sign up free

Indexability Checker

Find out whether Google and Baidu are allowed to index a page, and every reason if not.

About Indexability Checker

When a page won't show up in search, the first question is whether search engines are even allowed to index it. Run the indexability checker on a new page that gets no traffic, after a site migration, or when Google Search Console or Baidu Search Resource Platform reports excluded pages. Enter the URL and click Check.

The page is fetched as Googlebot and as Baiduspider, along with robots.txt, and you get a separate verdict for Google and for Baidu. Every reason is listed: a redirect, a status other than 200, a robots.txt rule, a robots.txt that answers with a server error, noindex in the robots, googlebot or baiduspider meta tag or in the X-Robots-Tag header, a canonical pointing to another page, a file that isn't HTML, or a soft 404. Buttons run a site: search on Google and Baidu. The checker can't tell whether the page is indexed right now, since only the search engine knows that, so use the site: search or the URL inspection in Search Console. To dig into the rules, open the Robots.txt Tester.

How to use Indexability Checker

  1. 1
    Enter the page URL

    Paste the exact address you want indexed.

  2. 2
    Click Check

    The page is fetched as Googlebot and Baiduspider, together with robots.txt.

  3. 3
    Read both verdicts

    Google and Baidu each get can or can't be indexed, with the reasons.

  4. 4
    Confirm in search

    Use the site: buttons, fix the reasons and check again.

Why use Cubfile for this

  • Google and Baidu apart

    Two verdicts, because rules and crawlers can differ.

  • Every blocking reason

    Redirects, status codes, robots.txt, noindex, canonical, soft 404 and more.

  • Header rules included

    X-Robots-Tag and crawler-specific meta tags are read.

  • site: search buttons

    One click to search for the page on Google or Baidu.

FAQ

Indexability Checker: questions and answers

Does this show whether my page is indexed?
No. It shows whether the page can be indexed. Only the search engine knows what's in its index, so use the site: search buttons, the URL inspection in Google Search Console or Baidu Search Resource Platform.
Why can Baidu index the page but not Google?
The page may carry a googlebot-only noindex, robots.txt may have a separate group for one crawler, or the server may answer the two crawlers differently. The list of reasons shows which. To compare what each crawler actually receives, use the Search Engine Spider Simulator.
What is a soft 404?
A page that says it doesn't exist but returns status 200. Search engines treat it as an error page, so return a real 404 or 410 instead.
Does a canonical pointing to another URL stop indexing?
It asks search engines to index the other URL instead, so this address usually won't appear in results. That's right for duplicates, but a mistake on a page you want to rank. The Meta Tag Checker shows the canonical alongside the page's other head tags.
Is the indexability checker free?
Yes. It doesn't use your daily tasks, needs no sign-up, and nothing is stored.
Share Indexability Checker with a friendIt runs in any browser, and they can try it without signing up.

Related tools

SEO Broken Link CheckerCheck every link on a page and list the ones that are broken or redirected.
SEO SEO CheckerCheck a page on 40+ on-page and technical SEO points, with a fix for each problem.
SEO Keyword Density CheckerSee which words and phrases a page repeats most, and how often.
SEO Meta Tag CheckerRead a page’s title, description, robots, canonical and social tags, with length checks.
SEO Robots.txt TesterRead a site’s robots.txt and test whether a URL is allowed for each crawler.
SEO Search Engine Spider SimulatorSee a page the way Baiduspider or Googlebot does, and whether it differs from what visitors get.
SEO AI Crawler CheckerSee which AI crawlers (GPTBot, ClaudeBot, Google-Extended…) your robots.txt lets in.
SEO Verify Googlebot and Baiduspider IPsCheck whether an IP in your logs really belongs to Google, Baidu or Bing.