What an AI search audit actually tests
A credible audit runs real queries against real engines and measures the results. The core method is prompt testing: a structured set of the questions your customers actually ask — discovery questions (“best [service] for [audience]”), comparison questions, and branded questions — put to each major engine, with every response scored. Are you present? Cited by name with a link, or mentioned in passing? Described accurately? Recommended, or listed as an afterthought behind competitors?
Around that core, a full audit examines the layers that explain the results:
- The technical layer. Crawler access (including AI-specific bots), page speed, site structure, and schema coverage. If a crawler can’t parse it cleanly, an LLM won’t surface it — the fundamentals still gate everything.
- The content layer. Not keyword matching but passage-level relevance: does any page answer each target question directly, in an extractable form? Content structured to rank and content structured to be cited are genuinely different things, and the audit measures the second.
- The entity layer. How the engines resolve your identity — whether your name, offerings, and facts are consistent across your site, schema, profiles, and the wider web, and whether you're being confused with someone else.
- The competitive layer. The same prompt set run for your top competitors, producing a citation-share comparison and — more usefully — the specific prompts where they win and you don’t.
The off-site signals most audits miss
AI engines behave like a consensus machine: before recommending a brand, they weigh what independent sources say. That means an honest audit has to look beyond your website at reviews, directory presence, press mentions, and citations on the sites each engine habitually pulls from — and different engines lean on different source ecosystems, so where you need corroboration depends on where you need visibility. The most common finding in this layer is stark: a business with excellent on-page optimization and near-zero third-party corroboration, invisible for every discovery query because the engines have no independent reason to believe it belongs in the answer.
Different engines, different sourcing — why one audit isn’t one number
A subtlety that separates real audits from superficial ones: the major engines do not draw from the same well. Google’s AI Overviews are grounded in Google’s own search index and quality systems, so your traditional Google standing feeds them directly. ChatGPT’s browsing leans on Bing’s index — meaning a business that never verified with Bing Webmaster Tools can be strong in Google and weak in ChatGPT for identical questions. Perplexity runs its own retrieval with heavy weighting toward sources it considers authoritative and current, and its citation behaviour is the most visible of the three. And the models’ training-data memory — what they “know” without searching — reflects long-term web consensus, which moves on a different clock entirely.
The practical consequence: your visibility is a profile, not a score. An audit that returns one blended number hides exactly the information you need — strong in AI Overviews but absent from ChatGPT is a Bing problem; cited everywhere except Perplexity is usually a freshness and authority problem. Engine-by-engine results tell you which lever to pull.
A DIY version you can run this afternoon
Before paying anyone, you can get a rough read yourself:
- Write down 15 questions a customer would ask on the way to finding a business like yours — discovery first (“best [service] in [city]”, “how do I choose a [category]”), then two or three branded ones.
- Ask each engine — ChatGPT, Perplexity, and a Google search that triggers an AI Overview — and paste every response into a spreadsheet.
- Score three things per response: are you present, are you described accurately, and who is recommended instead of you.
- Look for the patterns from the list below — they will be obvious within twenty minutes.
- Repeat monthly with the same questions, because the trend matters more than the snapshot.
What the DIY version can’t give you is diagnosis — why you’re absent — or competitor benchmarking at scale. But it establishes the baseline, and it usually makes the case for the full audit better than any sales page could.
What audits typically reveal
Patterns recur across almost every first audit:
- The ranking-citation gap. Pages ranking on page one of Google that never appear in AI answers, because the answer is buried, unstructured, or generic.
- Citation gaps by intent. Visible for branded queries (people searching your name) but absent for discovery queries (people searching for what you do) — the queries that actually create new customers.
- Entity confusion. Engines describing the business inaccurately, conflating it with a similarly-named company, or describing only part of what it does.
- Corroboration deficits. Competitors winning recommendations not on content quality but on reviews, mentions, and third-party presence.
- Self-inflicted invisibility. AI crawlers blocked by a template robots.txt nobody ever reviewed.
Each finding maps to a different fix — which is precisely why the audit matters. Restructuring content, correcting entity signals, and building corroboration are different projects with different costs; without the diagnosis you’re guessing which one you need.
What a useful deliverable looks like
Judge an audit by its output. You should get evidence — the actual engine responses, scored, not a summary claiming you “need improvement”; a competitive baseline — your citation share against named competitors on the same prompts; and a prioritized roadmap — what to fix first and why, sequenced by impact. A hundred findings with no order is homework, not help. And insist on a re-test plan: AI answers change continuously, so a single snapshot decays fast. Quarterly re-runs of the same prompt set turn the audit from a document into a measurement system.
Where this fits in your strategy
An AI search audit is the diagnostic layer, and it comes first for a simple reason: everything downstream — content restructuring, entity work, citation building — is guesswork without it. It answers the question every other investment depends on: where, specifically, are we losing? This is exactly what our Brand Audit was built around — prompt tests across the major engines, the entity and technical layers, and a prioritized fix list, at a deliberate fraction of agency pricing. If you want the two-minute preview first, our free visibility check shows you how the engines see you today. For the fundamentals of the discipline, start with what generative engine optimization is.
Our Research On This
Original SEMPITE studies — live queries, recorded answers, named sources. Free to cite under CC BY 4.0.
- Who Google’s AI Recommends in Sports Nutrition — 5.1% of AI citations go to brand-owned sites
- The 3 Publishers That Control Supplement AI Answers — 77% of AI supplement answers come via 3 publishers
- AI Visibility Index — 43% of Google top-3 businesses ChatGPT never mentions
SEMPITE helps small businesses and personal brands get found — in search and in AI answers.
Get in TouchFrequently Asked Questions
What does an AI search audit include?
A structured prompt test — your customers' real discovery, comparison, and branded questions asked across ChatGPT, Perplexity, Gemini, and Google's AI features, with every response scored for presence, accuracy, and recommendation strength — plus the layers that explain the results: technical crawlability and schema, passage-level content relevance, entity consistency, off-site corroboration, and a competitor citation comparison on the same prompts.
How is an AI search audit different from an SEO audit?
An SEO audit measures your ability to rank pages in search results; an AI search audit measures whether AI engines retrieve, trust, and cite you inside generated answers. The layers overlap (technical health matters to both) but the tests differ: prompt testing against live engines, extractability of answers, entity resolution, and citation share have no equivalent in a traditional SEO audit.
Can I do an AI search audit myself?
A basic version, yes: list 10–20 questions your customers ask, put them to each major AI engine, and record whether you're cited, mentioned, or absent — and who wins instead. That reveals your citation gaps. A professional audit adds systematic scoring, competitor benchmarking at scale, entity and technical diagnosis, and a prioritized roadmap, which is where the fix sequence comes from.
What do AI search audits usually find?
Five patterns dominate: pages that rank in Google but never get cited by AI (structure problems), visibility for branded queries but not discovery queries, entity confusion where engines describe the business wrongly or partially, corroboration deficits where competitors win on reviews and third-party mentions, and AI crawlers blocked by an unreviewed robots.txt.
How often should I re-run an AI search audit?
Quarterly for most businesses. AI answers change continuously as models update and retrieval indexes refresh, so a single snapshot decays quickly. Re-running the same prompt set on a schedule turns the audit into a measurement system — you see whether fixes moved your citation share and catch new gaps as engines evolve.
Why does my business rank well on Google but not appear in AI answers?
Because ranking and citation are different tests. Ranking rewards overall page relevance and authority; citation requires an extractable, direct answer, a clearly resolvable entity, and independent corroboration. A page-one ranking with a buried or generic answer loses the citation to a lesser-ranked page that states the answer cleanly — this is the most common finding in first audits.
Leave a Comment
Have a question or something to add? Drop a comment below.