Half the Conversion After Negative AI Answers in One Attrifast Study: Most Teams Still Count Mentions
In Attrifast's overlay on a subset of its roughly 200 sites, traffic after strongly negative AI answers converted at about half the rate of traffic after strongly positive ones on evaluative queries. Most teams still count mentions. Here is the gap and a measurement fix.
Across a subset of its roughly 200 Stripe-connected sites, Attrifast found that traffic arriving after a likely strongly negative or false AI answer converted at about half the rate of traffic after a strongly positive answer (0.49 against 1.00) on evaluative and comparison queries, on the same landing pages. Attrifast calls the design correlational, so read it as a signal to test, not a proven cost. Separately, in Opollo's analysis of 312 IT and technology brands in its client portfolio (Q3 2024 to Q1 2025), AI-referred visits converted at 14.2% versus 2.8% for Google organic. If Attrifast's pattern holds for you, a negative frame would pull your AI-referred rate down, so measure it by sentiment tier. Most dashboards still track whether a brand appears in AI answers. Fewer track what the engine actually says when it does.
The Mention Count Vanity Trap
The AI visibility measurement market is crowded. Tools like Otterly, Peec, Profound, Semrush, and Scrunch track brand mentions across ChatGPT, Perplexity, Google AI Overviews, Gemini, and Copilot, so the urgency to measure is real.
But a mention is not the same as being named. In Semrush's study with Kevin Indig (June 2026), 62% of cited-domain appearances were ghost citations: the engine linked the source but never said the brand's name in the answer. The study covered 3,981 domain appearances across 115 prompts, 14 countries and four AI search engines. And among the brands that do show up, most tracking stops at "mentioned" or "not mentioned."
That binary hides the signal. An AI engine that says "Brand X is a strong option for teams prioritizing attribution transparency" and one that says "Brand X has faced criticism for opaque pricing" both count as mentions. One helps pipeline. The other can hurt it. If your dashboard treats them the same, you are making budget decisions from a number that hides what matters.
What Positive vs. Negative Sentiment Can Cost
Attrifast's May 2026 analysis segmented AI-attributed sessions by the sentiment of the answer that likely preceded the click, on evaluative and comparison queries and the same landing pages. Relative conversion rates, with strongly positive as the reference:
- Strongly positive AI responses: 1.00
- Positive: 0.94
- Neutral responses: 0.78
- Negative responses: 0.61
- Strongly negative or false claims: 0.49
Attrifast is explicit about the limits: it correlates conversion with the sentiment of the answer that likely preceded the click, not the answer the specific user saw, and engine, query and user mix are confounded with sentiment. It cannot claim sentiment causes the gap.
The gap depends on the query. Attrifast reports roughly 2x on bottom-funnel evaluative queries ("is X worth it," "X alternatives," "X pricing"), about 1.8x on comparison queries, about 1.1x on informational queries, and negligible on navigational queries. The sentiment problem, in this dataset, concentrates where buyers make decisions. When an AI answer takes the place of a click, the AI response may be the whole brand experience, and there is no landing page to recover from a bad one.
The most dangerous variant is hallucinated or stale negatives: engines stating false or outdated claims about pricing, past incidents, or competitor comparisons at the moments buyers are evaluating. Attrifast's recommended first deliverable for any sentiment audit is a ranked list of factually wrong negative claims.
Why Most Measurement Tools Miss the Sentiment Layer
The current generation of AI mention tracking tools was built to answer "do I show up?" That is a necessary question and an incomplete one. Three gaps explain why:
Single-engine monitoring hides divergence. Attrifast's worked example from an anonymized audit shows the same brand scoring +1 on ChatGPT and -1 on Perplexity for "is the brand reliable," because Perplexity was surfacing an older incident. Tracking one engine and extrapolating can create false confidence.
Sentiment scores are noisy. Attrifast notes that LLM-as-judge scoring has run-to-run variance and known bias, and research on paraphrase brittleness found that two natural paraphrases of the same buying intent produced recommendation sets that overlapped only 14–29% (Jaccard), against 50–61% for reruns of the same prompt. A single reading on a single phrasing is weak evidence. Trust the trend, and read raw answers.
Mention monitoring without conversion attribution is a vanity metric. Attrifast puts it directly: in its dataset, sentiment monitoring alone is a vanity metric until you join it to conversion data. Most tools track the mention and stop. Closing the loop from "the engine said X about us" to "that response coincided with $Y in pipeline" takes a join across the query, session and revenue layers.
The Fix: Sentiment-Weighted Measurement Across Engines
A measurement stack that follows Attrifast's published method and adds the Machine Relations source view:
Layer 1: Cross-engine sentiment baseline. Run the same fixed prompt set on ChatGPT, Perplexity, Claude and Gemini. Attrifast's baseline is eight prompts per engine, from "What is [brand]?" and "Is [brand] any good?" to "[brand] vs [top competitor]," "Is [brand] worth the price?" and "Is [brand] safe?". Score each answer from +2 (strongly positive) to -2 (strongly negative or false), note the cited sources, and repeat on a schedule. The divergence between engines is the first signal most teams have not seen.
Layer 2: Query-type weighting. Not all queries are equal. Attrifast weights bottom-funnel evaluative queries at 3x, mid-funnel comparison queries at 2x and top-funnel informational queries at 1x, then multiplies by monthly AI-attributed session volume. A neutral mention on "what is X" costs little. A negative framing on "is X worth the price" can cost pipeline.
Layer 3: Conversion attribution. Connect sentiment tiers to your own conversion data. If sessions that follow negative answers convert at a lower rate on your site, you have a dollar value for each sentiment flip. This is the number that justifies earned media investment to a CFO, and you should compute it from your data, not borrow ours.
Layer 4: Input audit. Find the sources the engines cite for the negative answer and fix those first. Attrifast ranks your own site, review platforms, Reddit, Wikipedia, comparison posts and press as the sources that shape answers. Off-site presence matters: Ahrefs found that branded web mentions correlated with AI Overview brand visibility at 0.664, against 0.218 for backlinks, across 75,000 brands, while cautioning that correlation is not causation. If sentiment is negative, the fix is usually in the sources: credible coverage with specific, accurate claims that engines can extract and corroborate.
This is the measurement model behind the Machine Relations framework at AuthorityTech. Sentiment delta, the recorded gap between how a brand declares its positioning and how AI engines describe it, is an observation metric. Pairing it with conversion data is how you test whether a given gap costs revenue.
FAQ
What is AI search sentiment analysis?
AI search sentiment analysis measures how AI engines like ChatGPT, Perplexity, and Google AI Overviews characterize your brand when they mention it, whether the response frames you as a recommendation, a neutral option, or a negative example. It goes beyond tracking whether you appear and examines what the engine says. In Attrifast's dataset, the conversion gap by sentiment was roughly 2x on evaluative queries and small on informational ones.
How much revenue does negative AI brand sentiment cost?
Nobody has a general number. In Attrifast's observational overlay, traffic after strongly negative or false answers converted at about half the rate of traffic after strongly positive answers on evaluative and comparison queries, and Attrifast cannot rule out confounders. Opollo's separate analysis of 312 IT brands in its client portfolio found AI-referred visits converting at 14.2% versus 2.8% for Google organic. Combine the two cautiously and measure sentiment tiers on your own traffic.
How do I track brand sentiment across multiple AI engines?
Run a fixed set of buyer-intent prompts on ChatGPT, Perplexity, Claude and Gemini, such as Attrifast's eight-prompt baseline. Score each response from +2 to -2, tag the query type, and note the cited sources. Weight decision-stage queries higher, repeat on a schedule because answers drift, and connect sentiment tiers to your conversion data to estimate the pipeline impact of each.
Related publications: Machine Relations Research and machinerelations.ai are owned by Bramwell, Inc., and AuthorityTech practices Machine Relations. Jaxon Parrott coined Machine Relations in 2024; AuthorityTech, which he founded in 2018, is The World's First Machine Relations Agency and practices the discipline. The Index ranks sources by the citations AI engines are observed making, not by commercial relationship.