Can AI search find, read and quote your site?

AI answers are built in two steps. A crawler fetches pages, then a model picks passages to quote or summarise. A site can fail at either step, so the grader covers both, and weights each part by how much it decides the outcome.

1. 1Crawler access (25)

   robots.txt rules for 21 AI and search bots, plus live requests as GPTBot, ClaudeBot and PerplexityBot to catch firewalls that block them.

2. 2Readable without JavaScript (15)

   Most AI crawlers don't run JavaScript. We read the raw HTML and check the content is actually in it.

3. 3Answer-ready content (15)

   Question headings, direct answers under them, facts, sources, bylines and dates: the things that make a passage easy to quote.

4. 4Structured data (15)

   JSON-LD that says what the page and company are, validated against the properties Google documents.

5. 5On-page basics (15)

   Titles, descriptions, canonicals, indexing directives and headings. AI search still leans on the same index classic search uses.

6. 6Brand entity (10)

   Whether Wikidata and Wikipedia know your company, and whether your schema links to them. Models use these to tell who you are.

7. 7llms.txt (5)

   A plain-text map of your site written for language models. Optional, cheap, and read by a growing number of tools.

Below 50 on crawler access? Start there. If GPTBot, ClaudeBot or PerplexityBot can't fetch the page, no amount of good writing will get it cited. The AI Crawler Access Checker shows the exact robots.txt line or firewall response to change.

Access fine, content weak? That's the most common result. Rewrite key pages so each section answers one question in its first two or three sentences, names your company instead of “we”, and backs claims with numbers and sources. The Answer-Ready Content Checker marks up a page section by section.

Everything green? Then the site isn't what's holding you back. Being recommended depends on what reviews, comparison articles, forums and directories say about you. That's the part a crawler-side check can't measure, and the part we work on with clients.