Start with evidence boundaries
An AEO data stack is useful only when every signal keeps its meaning. A crawl describes what your site exposed at a moment in time. Search Console describes Google search performance. Analytics describes visits that reached your site. Controlled answer observations describe what a chosen model returned under recorded conditions.
The five evidence layers
- Owned-site crawl evidence
URLs, status codes, canonical signals, headings, structured data, internal links, and extractable page text captured during an explicit crawl.
- Search demand
Queries, pages, clicks, impressions, and positions reported by Search Console, with the dimensions and date range retained.
- Referral traffic
Sessions and engagement from attributable sources in GA4, including the native AI Assistant channel when available.
- Crawler access policy
The robots.txt rules and page directives that govern whether named crawlers are allowed to fetch content.
- Controlled answer observations
Saved prompts, model and locale conditions, raw responses, observed mentions, and observed citations.
Google now provides a native AI Assistant default channel in Analytics, so use that classification before maintaining a custom regex as the primary workflow. [1]
Search Console can report Google generative-AI search appearances, but the report remains a Google-owned view with its own eligibility, dimensions, and aggregation. It is not a universal AI citation ledger. [2]
Crawler policy is configuration, not proof of a visit
OpenAI distinguishes OAI-SearchBot, which supports search discovery, from GPTBot, which is used for training controls. A robots rule can allow or disallow access, but it does not prove that a crawler visited a page. CiteLadder evaluates public crawler policy; it does not ingest or monitor server or CDN logs. [3]
Join evidence without flattening it
- Normalize URLs while retaining the exact source URL and capture time.
- Keep provider rows append-only and attach the provider, dimensions, and observation window.
- Separate unavailable and failed observations from valid zero values.
- Compare like-for-like windows and prompt conditions before describing movement.
- Link every recommendation back to the crawl, report row, or answer observation that supports it.
Once the foundation is connected, use the content audit guide to find page-level gaps and the four-part measurement taxonomy to keep those evidence streams distinct once they are reported. Explore Demand Intelligence for first-party query and page evidence, or Search Intelligence for optional external keyword, competitor and backlink research.
Sources
- Default channel group: AI Assistant, Google Analytics Help
- Generative AI performance report (Search), Google Search Console Help
- OpenAI crawlers, OpenAI Platform Docs
Related reading
- Website readinessHow to audit a website for AI search readiness.Check the page a visitor or crawler can access before changing the copy. Work through technical and content evidence in a clear order.
- CitationsHow to turn AI citation findings into useful website improvements.Read the source, identify the missing answer and choose a defensible next step. A practical workflow for investigating AI citation opportunities.
- AI Search PromptsFrom keywords to buyer questions: how CiteLadder builds AI search prompt portfoliosA useful AI-search prompt portfolio represents real buying decisions, not every question a model can invent.