AI Search
AEO Audit Checklist: 15 Technical Checks for Any Public Site
Direct answer: to audit a live public site, verify three things:
- Ordinary search crawlers and the search-specific agents you want can reach it.
- Each page is indexable and canonical.
- The visible information is accurate.
These checks improve technical eligibility. They do not guarantee a citation or recommendation.
AEOprobe labels checks by evidence level: confirmed requirements, web fundamentals, useful heuristics, and experimental signals. Work through the list below as a recurring audit, then measure real impressions, referrals, audits, and sign-ups.
Launching a SaaS product and want the short pre-launch version? Use the AI-search launch checklist for SaaS founders. This post is the longer audit for sites that are already live.
Access and crawler policy
- Return a successful public response. The canonical URL of each key page should return a stable 200 response without authentication, bot challenges, or a redirect loop.
- Keep robots.txt reachable. Serve it from the origin root and make sure its wildcard rules do not accidentally block the entire public site.
- Allow the search agents you intend to support. Review OAI-SearchBot, Claude-SearchBot, PerplexityBot, Googlebot, and Bingbot separately.
- Decide on training independently. GPTBot, ClaudeBot, and Google-Extended are not interchangeable with the corresponding search controls.
- Treat user-fetch agents separately. ChatGPT-User, Claude-User, and Perplexity-User represent user-requested retrieval and may follow different access rules.
Indexability and identity
- Do not ship an accidental noindex. Check both HTML robots metadata and X-Robots-Tag headers.
- Set one clean canonical. Tracking-parameter variants should point to the same clean public URL.
- Publish a useful title and description. They should describe the product and intended user without unsupported superlatives.
- Use accurate organization and product metadata. Structured data must match visible content and current pricing. It is descriptive, not a citation shortcut.
- Expose real ownership and contact information. Link to an About page, methodology, and a working contact route.
Discovery and rendering
- Include the page in an accurate sitemap. Use a real modification date and do not include redirects, auth pages, or noindexed pages.
- Link to the page contextually. Navigation alone is not enough. Relevant product, documentation, and launch pages should reference it.
- Render the critical answer in initial HTML. Product name, audience, capability, pricing context, and documentation links should not depend on a client-only request.
- Make the page work for people. Mobile usability, accessible names, alt text, readable structure, HTTPS, and reliable performance are worthwhile web fundamentals.
- Measure the outcome. Record landing page, audit start, audit completion, report share, and sign-up without sending audited site addresses to analytics.
What this checklist does not prove
It does not prove that a site is indexed by every vendor, that a model understands the brand correctly, or that the brand is mentioned for a commercial prompt. Those outcomes require vendor-specific inspection, live prompt monitoring, and first-party conversion data.
Run a free technical audit to turn these checks into a list of findings to fix. The audit covers up to 3 pages and needs no sign-up.
Questions
Does passing this checklist guarantee AI citations?
No. The checks cover observable technical eligibility and web-quality fundamentals. Search and AI products make independent indexing, ranking, and citation decisions.
Should a site allow OAI-SearchBot to appear in ChatGPT search?
OpenAI documents OAI-SearchBot for ChatGPT search and GPTBot for potential model training. A site can allow search while making a separate training choice.
Does Google require llms.txt or special AI schema?
No. Google says its Search systems do not use llms.txt and that ordinary Search eligibility remains the technical requirement for AI Overviews and AI Mode.
Related posts
What Is Answer Engine Optimization (AEO)? The Complete Guide for 2026
AEO is the technical groundwork that lets search and AI answer products reach, index, and understand your website.
Read morerobots.txt for AI Search: OAI‑SearchBot, Claude, and Perplexity
AI search, user-fetch and training crawlers are separate robots.txt choices. Set each one for OpenAI, Anthropic, Perplexity and Google.
Read moreSchema Markup Audit: Each Structured-Data Check and the Block That Fixes It
What our audit checks in JSON-LD, in the words its report uses, with the example block that fixes each check.
Read moreCheck what AI crawlers can actually reach
Run a free audit to find public crawler, indexing, markup, and page-structure issues.
Run free audit