Can an AI medical council give a safer second opinion?
A 300-case preprint found structured multi-stage reports scored better on management planning, but an automated judge, unusual published cases and unequal compute prevent any claim of clinical benefit.
The short version
3 key points
- 1.Eight model pipelines generated reports for 300 resolved NEJM cases: 110 for physician-based judge calibration and 190 for held-out evaluation.
- 2.Structured final reports scored higher overall in seven of eight pipelines, with the clearest reported gain in management planning.
- 3.The benchmark did not test clinicians, patients or outcomes, and its council used more calls and tokens than a standalone response.
The benchmark found better reports, not better care
A structured, multi-stage AI 'council' produced more highly rated clinical second-opinion reports than a single role-specific response in a new 300-case benchmark. Its clearest advantage was management planning. That finding could help researchers evaluate decision-support systems more realistically than asking only whether a model names the diagnosis. It does not show that an AI council makes clinicians more accurate or patients safer: no clinician used the reports in care, and no patient outcome was measured.
The unreviewed preprint, submitted on 15 October, used diagnostically resolved case records published in the New England Journal of Medicine between 2015 and 2023. Researchers assigned prompted clinical roles, generated independent opinions, then had the same model synthesise them through up to five review rounds. Eight model pipelines were tested under free-form and structured instructions. The correct-answer field was withheld from generation.[1]
How the 300 cases were divided and scored
A fixed 110-case set supplied physician reference ratings and calibration data for an automated LLM judge; the remaining 190 DOI-distinct cases formed the held-out evaluation. Six physicians rated outputs blind to model and format on a 0–3 rubric covering grounding, prioritisation, use of evidence, reasoning, differential diagnosis, final conclusion, management and safety. The calibrated judge then scored the large evaluation set: 6,080 response components and 54,720 criterion outcomes.
Across the held-out cases, structured final reports had higher overall mean scores in seven of eight pipelines. The pooled management score rose from 2.436 for free-form reports to 2.740 for structured reports. Final structured synthesis also scored above the pre-council primary-role output across five shared criteria. Model identity separated quality more strongly than format, and the strongest pipeline in the paper also consumed substantial resources: its mean tokens per case rose from about 65,200 free-form to 132,100 structured.[1]
The distinction that matters
What the benchmark compared
Each route began with the same published case, but the generation process differed.
Single role
One prompted specialty writes an opinion
Role-specific report
AI council
Several prompted roles are synthesised and reviewed
Final multidisciplinary report
Why the council effect cannot be isolated
The council condition combined extra sampling, role prompts, aggregation, critique, revision and more context. There was no compute-matched control, so the study cannot say discussion itself caused the gain. Prompted specialties were simulated viewpoints rather than independently validated specialists and could repeat the same error. The cases also overrepresent rare, difficult diagnoses; titles and DOIs were supplied during synthesis, and public cases may have appeared in model training data.
The automated judge is another boundary. Physician calibration improved agreement on some criteria, but validation error remained high for the composite final-conclusion score. The paper reports no funding or competing-interests statement in the accessible version, while authors list academic, clinical, institute and commercial affiliations. A stronger next step would compare equal-compute pipelines prospectively, then test whether blinded clinicians using the reports make safer decisions. For now, the study supports a richer benchmark—not clinical deployment or patient self-diagnosis.[1]
Evidence check
This is an unreviewed benchmark of published cases scored mainly by an automated judge. It tested neither clinician decisions nor patient outcomes and did not match compute between the compared workflows.
Reporting basis: Source analysis. Original source date: 15 October 2026.
Explore the full source and evidence record
What this means for people
- Clinicians may benefit from a report that separates evidence, uncertainty and management, but they still need an independent way to verify every consequential recommendation.
- Patients should not treat benchmark rankings as evidence that an AI second opinion is safe or effective for their own care.
Global context
The authors are mainly affiliated with Russian institutions, but the cases came from a US medical journal and the models are internationally available. Health systems would still need local validation, governance and prospective clinical evidence.
What the evidence does not yet show
- This is an unreviewed benchmark of published cases scored mainly by an automated judge. It tested neither clinician decisions nor patient outcomes and did not match compute between the compared workflows.
What to watch next
- Equal-compute replication, independent physician review and prospective trials measuring clinician decisions, workload and patient safety.
Living evidence record
Impact record IAI-1HSLRBT
Evidence stage
Studied
Confidence
Supported
Reporting basis
Source analysis
Independent or research support
Not yet
Record status
Monitoring
Last checked
16 October 2026
Source trail
1 direct source across 1 source type.
People impact
Documented in this record.
Uncertainty
Limits and next checks are explicit.
Stages describe the evidence available—not whether a technology is good or bad. See the public method.
Single-source reporting disclosure
This record analyses one direct source. It can establish what Bokov et al. (arXiv) published or reported, but it is not independent corroboration of every performance claim or predicted outcome. The confidence label will change only when broader evidence is added.
Evidence trail
Sources used for this report
Links checked 16 October 2026
Research question, topics and regions
Evaluation of LLM-generated multidisciplinary clinical second opinions
Topics: Clinical AI · Second opinions · AI evaluation · Patient safety · Multi-agent systems
Regions: Russia · Global
This report is labelled source analysis. We summarise and analyse source material in our own words; company statements remain attributed claims until independently supported. Translated summaries preserve the meaning of the original source and link back to it. Read our editorial standards.
Watch the background, then check the evidence
The Royal Society
AI-generated illustration · not a video frame
YouTube loads only when you choose. Press play in the player to start. If playback is unavailable, use “Watch on YouTube” below.
Healthcare, culture & human impact · Background explainer
Published 2026-07-01 · 44 min 28 sec
Is this the AI future we want? | The Royal Society
A Royal Society discussion with Madhumita Murgia and biomedical engineer Alison Noble on AI’s potential in healthcare, science and culture, recorded at the 30 June 2026 event.
Evidence check: A discussion of opportunities and risks, including future possibilities. It is not evidence that every application described is available or clinically proven.
Source checked 14 October 2026. Check available captions on the publisher’s video page.
The Impact Brief · Free
Keep following the stories that matter to you.
Get our weekday briefing on what changed and why it matters. Choose your topics below.
Continue the story
There’s more to this story
Health & Life Sciences
What do AI mental-health chatbots still get wrong?
A company-built benchmark scored 61,819 replies from 18 models across synthetic, three-session support conversations. Repetitive questioning and poorly calibrated guidance dominated the errors—but synthetic patients, one English prompt and automated judging cannot establish clinical safety or benefit.
7 min · 1 source
Health & Life Sciences
Can a high-AUC diabetes model still be unsafe?
New analysis today of a peer-reviewed 2 October audit of 12 machine-learning approaches on two public diabetes datasets. Similarly ranked models can differ materially in calibration, uncertainty and safe deferral, but this is a benchmark study—not a clinical trial, diagnostic approval or evidence of improved patient outcomes.
7 min · 3 sources
Health & Life Sciences
What are clinicians asking an AI evidence platform?
A JAMA study counted 271 million OpenEvidence queries from 952,008 US clinicians. Treatment and management dominated a classified sample—but the logs cannot show whether answers were correct, used in care or improved patient outcomes.
9 min · 1 source
Reader commentary
What does this mean where you are?
Tell us what you have seen at work, in your community or in everyday life. A question is welcome too. No account is needed; we review notes before publishing them.
Explore commentary across the portal →Published reader notes
0No published reader notes yet. You can start the evidence-led discussion above.
Prefer a private correction or response? Contact the newsroom.