A1 · Crawlability & Indexability

    Indexability Checker — is your page eligible to be indexed?

    The indexability verdict is a single yes/no answer to one question: is this page allowed to be indexed by search engines and read by AI crawlers? GEObubbly produces it by combining five independent signals — the HTTP status code, robots.txt, the meta robots tag, the X-Robots-Tag HTTP header, and the canonical tag — into one verdict. If any of them blocks indexing, the page won't appear in search results or be cited in AI answers, no matter how good its content is.
    Updated June 2026 · Technical SEO & GEO · Part of Crawlability & Indexability

    Run a free indexability check

    Paste any URL — GEObubbly checks HTTP status, robots.txt, meta robots, X-Robots-Tag and canonical, then returns one clear verdict in seconds. No signup.

    ✓ Free check✓ 5 signals✓ No signup required
    In short: The indexability verdict combines HTTP status, robots.txt, meta robots, X-Robots-Tag and canonical into one yes/no answer. If any signal blocks indexing, the page can't appear in search or be cited by AI.

    What does the indexability verdict check?

    It answers one question with a single verdict: is this page eligible to be indexed and shown? Rather than testing one signal at a time, it rolls up five independent indexing signals, because each can block a page on its own:

    • HTTP status — the page must return a genuine 200 OK, not a 4xx, 5xx or a soft-404.
    • robots.txt — no Disallow rule may block the URL or its critical resources.
    • Meta robots tag — no noindex in the page's <meta name="robots">.
    • X-Robots-Tag header — no noindex in the HTTP response header (invisible in the page source).
    • Canonical tag — the canonical must point to this page or the correct primary version, not a blocked or redirecting URL.

    If all five are clear, the page is indexable. If any one blocks indexing, the verdict fails.

    How is it evaluated, and how is it scored?

    GEObubbly fetches the page and its robots.txt, reads the response headers and the rendered <head>, follows the canonical, and combines the five signals into one verdict. It's a core, automatically-run check carrying a weight of 5 points — the highest in the Crawlability & Indexability category — because nothing else you do matters if the page can't be indexed in the first place.

    Why indexability matters for SEO and GEO

    Indexability is upstream of everything. A page that can't be indexed scores zero where it counts: it won't rank in search, and it won't be available for AI answer engines like ChatGPT, Perplexity and Google AI Overviews to read and cite. The most common cause is an accidental noindex — left over from a staging environment, applied by a CMS setting, or hidden in an X-Robots-Tag header nobody checks. Because the failure is silent, it can suppress a page for months before anyone notices. Getting the indexability verdict to pass is the first, non-negotiable step toward both search rankings and AI citations — from there, the rest of the Crawlability & Indexability checks and the heavier GEO / LLM Readiness signals build on a page that can actually be seen.

    How this check scores
    Pass: every signal clear — the page is eligible for indexing.
    Warning: indexable, but a soft signal is off (e.g. nofollow).
    Fail: a noindex/block from any source makes the page non-indexable.

    FAQ

    An indexability verdict is a single, combined answer to the question "can this page be indexed and shown by search engines and AI engines?" Instead of checking one signal in isolation, GEObubbly evaluates the HTTP status code, robots.txt rules, the meta robots tag, the X-Robots-Tag header and the canonical tag together, because any one of them can silently block indexing. The verdict tells you in one line whether the page is eligible to appear in results — the prerequisite for everything else in SEO and GEO.

    Related checks in Crawlability & Indexability

    A2
    robots.txt reachable & not blocking
    A3
    Meta robots directives
    A4
    X-Robots-Tag header
    A7
    Canonical tag valid

    Audit your page across all 14 checks in Crawlability & Indexability

    See which checks pass, warn or fail — in seconds.

    Run a free audit →
    ← Back to the full Crawlability & Indexability guide
    Free TrialContact