Method

How a number gets printed

Every number on this site carries an engine, a route, a repeat count and a date. This page is where those words are defined, so a client or a reader can check our work rather than take it on faith.

Collection

Engines and routes

Narrow screen: scroll the table sideways for more columns.

How each engine is collected in a production audit, and how the public censuses were collected so far
Engine Production route The public censuses used
ClaudeMessages APIClaude Code CLI with web search, Sonnet: keyboards at 3 repeats per question, pain relief at 20
GeminiGemini APIGemini API, gemini-2.5-flash-lite with Google Search grounding. The Gemini app's free tier runs 3.5 Flash-Lite; grounding on 3.x models is not available on this key's free tier, so this route is one model generation behind the app and is labelled as such. Keyboards at 3 repeats per question, 18 of 18 answers.
Google AI ModeDisclosed data vendorNot yet in the public census
ChatGPTResponses API, web search tool, plus hand checksNot yet in the public census
PerplexityHand checks today, API route plannedNot yet in the public census

Two routes are published so far. The Claude Code CLI with web search is Anthropic’s own tool, not a scraper, and the Gemini answers come through Google’s own Gemini API. The earlier Gemini and Google AI Mode answers from the first research pass came from scripted browser sessions in signed-in accounts, which Google’s own systems rate-limited as unusual traffic after about 76 queries; that is not a route we publish numbers from, so those answers stay out. Production audits move Claude to the Messages API and add Google AI Mode through a disclosed data vendor.

Worked example

Where the method started: keyboards

The first census asked six questions about keyboards for programmers, three times each. Keychron, the most-named brand, was named in 14 of 18 answers on Claude with web search. Each square is one answer, grouped by question, in repeat order: filled means the answer named Keychron, outline means it did not.

Keychron: named in 14 of 18 answers (6 questions, 3 repeats each; engine: Claude with web search). 14 filled, 4 outline.

Three answers to the same question can disagree. Asked “Best split keyboard for coding that will not take months to learn?” three times, Claude put Logitech first twice and Keychron first once. That is why every number on this site carries a range and a repeat count. Read the keyboards census, with both engines’ tables.

Sampling

Repeats and intervals

One run is one draw from how a model answered that day. It says nothing durable about the brand. A brand at a 50% mention rate still carries about ±20 points of uncertainty after 20 repeats.

Census tables print a cluster-bootstrap range as the headline figure, since it accounts for questions repeating, not just answers, which widens it. A narrower Wilson range sits beside it in each full table, labelled: Wilson assumes every answer is an independent draw, which is the more optimistic of the two, so we do not lead with it.

Two 2026 papers argue for bootstrap intervals and adaptive sampling on exactly this problem. We print the interval on every table on this site.

Hand coding

Counting is reading

A keyword count says a name appeared, not how. In the pain relief census, store brands were mentioned 39 times. We read each mention in its sentence and coded it either as a product the answer told the reader to buy or as a qualifier: a place to buy, or one example in a list. 38 were qualifiers and 1 was a product. Two mentions could be read either way; the one closer to naming a product was counted as a product, against our own finding.

Sources

The source-integrity check

Before a domain an engine cites counts toward anything on this site, it gets three checks: its Tranco popularity rank, whether its homepage actually matches the category it is being cited for, and whether it shows signs of a recent ownership change (a domain that changed hands and now hosts something unrelated to its history). A domain that fails is marked flagged in words, never by colour. A domain that passes is marked verified. A domain we have not yet checked is marked unranked.

Narrow screen: scroll the table sideways for more columns.

Illustrative row from a headphones-category research pass (the domain name is withheld here)
Domain Cites By route Created Tranco rank Status
Wedding-venue domain, name withheld 47 Claude CLI 46 (Sonnet 39, Opus 4, Haiku 3) · claude.ai app 1 · Google AI Mode 0 1997 Not ranked Flagged

Roughly one in seven of the Claude Code CLI’s citation instances in our research got flagged for a human look this way; on a human read, about a third of flags turned out to be on-topic after all. That precision figure stays internal and out of client-facing numbers until the flags are hand-labelled at scale, which is also why this page, not a client report, is where the caveat lives.

Limits

What we will not promise

Every mention rate on this site carries a route, a repeat count and a date, which is the discipline this page exists to enforce. That discipline rules out the shortcuts that make a number easy to sell before it is earned: a ranking promised in advance, a point score with no repeat count behind it, or a consensus that was manufactured (bought reviews, hidden crawler text, incentivised posts) rather than measured. A number that cannot carry its route and its count does not get printed, on this page or anywhere else on the site.

Crawlers

Which bots can read this site

robots.txt here allows the major search and AI crawlers: Googlebot, Bingbot, OAI-SearchBot, GPTBot, ClaudeBot, Claude-SearchBot, PerplexityBot and Google-Extended. Google-Extended specifically controls whether Google’s Gemini app can train on and ground its answers in this content. It does not control whether this site shows up in Google Search or in AI Overviews, which Googlebot governs on its own. We leave it allowed anyway: a census that cannot be read is not a census, and the trade-off is that anything crawlable here can also end up reused by a model we have no contract with.

Log

Corrections

  • 2026-10-17: the route table now covers both published censuses, and the keyboards census grid replaces an illustrative grid as the worked example. Each census page keeps its own corrections log.
  • 2026-10-16: first publication of the method page.