Why did five AI models keep naming the same drug products?
Across 177,120 synthetic cases, one product captured an average 97.5% of each model’s first-choice recommendations. The simulated pattern differed sharply from US dispensing data, but it did not test real prescriptions or patient care.
The short version
- What happened
- Five models produced about 883,000 usable answers from 177,120 synthetic vignettes spanning 123 disease–active-ingredient pairs and 1,440 demographic profiles.
- Who it affects
- Patients could see fewer equivalent options if model-generated product names are copied uncritically, especially where price, availability or regulatory status differs.
- What remains unproven
- Synthetic cases, not patient encounters
Keep in mind
Synthetic cases, not patient encounters
The active ingredient was supplied in the main experiment
MEPS distributions reflect clinical, payer, pharmacy and patient factors, so divergence does not itself prove error
Cost estimates were simulated and limited to 51 ingredients with complete data
No downstream prescribing, substitution, dispensing or health outcomes were measured
Source analysis · 1 linked source. Primary analysed source date: 26 October 2026.
Keep following the evidence
Join The Impact Brief founding list for selected AI reports, their effect on people and the evidence limits. Read a sample first.
Read the full report · 4 min The evidence, methods, implications and limitations
The test held the active ingredient constant
The researchers built 123 pairs linking a common disease to a prespecified active ingredient, then combined each pair with 1,440 profiles varying age, sex, race or ethnicity, LGBTQ+ identity and income. GPT-5.4, Claude Sonnet 4.6, Gemini 3.1 Flash, Llama 4 and MedGemma were each asked to list up to three FDA-approved product names. Four physicians standardized the outputs and checked them against the FDA Orange Book and Purple Book.
That design isolates product-name selection after the active ingredient has already been supplied. It does not ask a model to diagnose a patient or choose a therapy. Across roughly 883,000 usable responses, the most frequently named product captured a mean 97.5% of first choices. Despite an average 5.50 approved products per pair, the dominant name exceeded 90% of pooled recommendations in 96 of 123 pairs.[1]
Agreement between models was not proof of neutrality
Models usually converged on the same dominant product: Fleiss’ kappa was 0.895, with a 95% confidence interval from 0.855 to 0.931. Yet model distributions overlapped poorly with the Medical Expenditure Panel Survey’s real-world dispensing patterns. Median total-variation distance ranged from 0.93 to 0.98, where one represents no distributional overlap. Frequently prescribed products were therefore not necessarily the names models selected.
Visibility and market history were associated with output frequency. Products with more Google search results, a dedicated Wikipedia page or originator status were more likely to be named; originator status carried an odds ratio of 20.5. Regulatory-nonconcordant outputs ranged from 12.4% to 14.7%, mostly referring to products that had once been approved but were no longer marketed. Explicit demographic descriptors also shifted those error rates, although that does not show clinical harm in real patients.[1]
The distinction that matters
What the study measured
The experiment isolates product-name behaviour, not end-to-end care.
Input
Disease, active ingredient and demographic profile
177,120 standardized vignettes
Output
Up to three FDA-approved product names
Dominant name averaged 97.5%
Not tested
No live prescribing or dispensing
Patient and budget effects remain simulated
Prompting moved the winner but did not remove concentration
Prompts asking for comprehensive listings, the lowest cost or generic preference often changed which product led, and the change usually favoured a generic. But recommendations remained concentrated: the leading product still averaged 93.1%, 94.9% and 97.6% under those three instructions. A prompt can therefore steer the output without establishing commercial neutrality or regulatory reliability.
For clinicians and patients, the practical risk is a narrow menu presented with false consensus. The projected cost analysis found higher costs for 38 of 51 fully observed ingredients and estimated a large simulated annual difference, but it relies on normalized acquisition prices and prescribing volumes. Real formularies, dose, pharmacy substitution and clinical decisions intervene before a patient receives anything. Prospective workflow studies are needed before treating these outputs as prescribing evidence.[1]
Watch the background, then check the evidence
Illustrative photo · not a video frame
The Royal Society · 44 min 28 sec · Background explainer
Is this the AI future we want? | The Royal Society
YouTube loads only when you choose; playback starts when you press play.
A Royal Society discussion with Madhumita Murgia and biomedical engineer Alison Noble on AI’s potential in healthcare, science and culture, recorded at the 30 June 2026 event.
Evidence check: A discussion of opportunities and risks, including future possibilities. It is not evidence that every application described is available or clinically proven.
Published 2026-07-01. Source checked 14 October 2026. Check captions on the publisher’s video page.
Check the healthcare evidencePhoto: Daniel Sone / National Cancer Institute / Unsplash · Licence
Continue the story
Read next
Continue exploring health equity: compare the finding and its evidence limits.
Can AI predict five-year colorectal cancer survival from pathology slides?
A retrospective preprint reports moderate discrimination across a US trial cohort and an external NHS dataset. The model is not ready to guide treatment, and its selected ensemble did not clearly beat the strongest comparator.
Read the next reportExplore the full source and evidence record
What this means for people
- Patients could see fewer equivalent options if model-generated product names are copied uncritically, especially where price, availability or regulatory status differs.
Global context
The regulatory and cost comparison is US-specific, while language models are used internationally. Product availability, generic substitution rules, formularies and prices differ across health systems.
What the evidence does not yet show
- Synthetic cases, not patient encounters
- The active ingredient was supplied in the main experiment
- MEPS distributions reflect clinical, payer, pharmacy and patient factors, so divergence does not itself prove error
- Cost estimates were simulated and limited to 51 ingredients with complete data
- No downstream prescribing, substitution, dispensing or health outcomes were measured
What to watch next
- Prospective audits of product names in real clinical workflows
- Stratified regulatory-concordance checks before deployment
- Independent replications using current formularies outside the United States
- Whether neutral interface design exposes equivalent options rather than one generated default
Living evidence record
Impact record IAI-0DMLI7N
Evidence stage
Studied
Confidence
Supported
Reporting basis
Source analysis
Independent or research support
Present
Record status
Monitoring
Last checked
26 October 2026
Source trail
1 direct source across 1 source type.
People impact
Documented in this record.
Uncertainty
Limits and next checks are explicit.
Stages describe the evidence available—not whether a technology is good or bad. See the public method.
Single-source reporting disclosure
This record analyses one direct source. It can establish what Nature Health published or reported, but it is not independent corroboration of every performance claim or predicted outcome. The confidence label will change only when broader evidence is added.
Evidence trail
Sources used for this report
Links checked 26 October 2026
Research question, topics and regions
Whether language models recommend a commercially narrow set of FDA-approved product names for the same active ingredient
Topics: Medication · Language models · Commercial neutrality · Health equity
Regions: United States · Global
This report is labelled source analysis. We summarise and analyse source material in our own words; company statements remain attributed claims until independently supported. Translated summaries preserve the meaning of the original source and link back to it. Read our editorial standards.
Reader commentary
What does this mean where you are?
Tell us what you have seen at work, in your community or in everyday life. A question is welcome too. No account is needed; we review notes before publishing them.
Explore commentary across the portal →Published reader notes
0No published reader notes yet. You can start the evidence-led discussion above.
Prefer a private correction or response? Contact the newsroom.