SEMPITE Research · Census · August 2026
We Scored 307 SEO Agencies With Our Own AI-Readiness Rubric
These are the agencies winning Google’s organic results for “SEO agency” across 30 US metros — the best-case sample. We ran every one of their websites through the same public, deterministic 24-check AI-readiness rubric we score client sites with. The median is respectable. The failure rates on individual checks are not.
What SEO agencies fail on their own sites
Share of the 307 agencies failing each check outright (partial credit not counted as failure). Single crawl, August 30, 2026.
The score distribution is bimodal
Most agencies cluster at 70–100. Then there is a second spike at 20–29: sites the rubric could barely read — JavaScript-only rendering, bot walls, or broken responses. To a search crawler or an AI engine, those sites look the same way they looked to us.
What the census shows
1. The industry passes its own exam — with a gentleman’s C on the new material. The classic hygiene is mostly there: titles (93.5%), robots.txt (89.6%), fast-enough homepages (88.6%). The AI-era layer is where it thins out: half the industry has no llms.txt and no answer-formatted content, and more than a third has no content schema.
2. One in five has no structured data at all. Not imperfect markup — zero JSON-LD on the homepage of a business that sells search optimization. Structured data is how AI engines confirm who a business is; these agencies are asking clients to buy a discipline they haven’t applied to themselves.
3. One in ten ranks despite a site a machine can barely read. The 20–29 spike is 10% of the sample. They rank on reputation, links, and history — which proves authority can carry a weak site, and also that their example is a poor template for a small business that has no authority yet.
4. Agencies are not blocking AI — the paranoia narrative is wrong here. Only 3.6% block GPTBot, and under 1% block ChatGPT-User or PerplexityBot. Whatever agencies say about AI scraping, their robots.txt files have voted: they want to be in the answers.
The buyer’s takeaway: before hiring an SEO agency, spend sixty seconds checking whether they practice what they will bill you for. View their homepage source and look for application/ld+json; try their-domain.com/llms.txt — or run their domain through the same free rubric we used. It is public, deterministic, and takes ten seconds.
Method
Sample: the top 20 organic Google results (US) for 36 queries — six generic phrasings of “SEO agency/company” plus “seo agency {city}” for 30 large US metros — collected August 30, 2026. Directories, review platforms, job boards, media sites, and SaaS tools were removed by blocklist plus a manual pass (14 removals), leaving 307 unique agency domains. Each was scored once with SEMPITE’s public AI-readiness rubric — 24 deterministic checks across structured data, AI-crawler access in robots.txt, machine readability, llms.txt, answerability, and discoverability; the full rubric is published. No agency is named; this is a census, not a leaderboard.
Limitations
The rubric is ours, and it weights the AI-visibility layer we specialize in — that is disclosed, and the scoring is deterministic and reproducible by anyone. Scores reflect the homepage and site-level files on one crawl date; JavaScript-only sites under-score by design, since AI engines reading raw HTML face the same wall. The sample is agencies that already rank — a best-case selection, which makes the failure rates conservative for the industry as a whole.
Would your site pass the same 24 checks?
Run the free rubric — the identical scoring used in this census, with your fixes listed.