A medical image model covered 10 modalities—but its 13,443-sample test was not a clinical trial
EVLF-FM combined diagnosis, visual grounding and question answering across six specialties. Strong benchmark scores and physician ratings do not yet show safer decisions or better patient outcomes in routine care.
The short version
- What happened
- EVLF-FM was developed and tested with more than 1.3 million samples from 18 datasets spanning 10 imaging modalities and six clinical specialties.
- Who it affects
- Clinicians could eventually use one system across several image types, but patients would bear the consequences of missed disease, false alarms or misplaced confidence. Those outcomes were not measured in this study.
- What remains unproven
- Peer reviewed
Keep in mind
Peer reviewed
More than 1.3 million development and test samples
13,443 external samples
17 external datasets
12 physician graders
No prospective workflow test
No patient outcomes
Source analysis · 1 linked source. Primary analysed source date: 29 October 2026.
Keep following the evidence
Join The Impact Brief founding list for selected AI reports, their effect on people and the evidence limits. Read a sample first.
Read the full report · 4 min The evidence, methods, implications and limitations
One model, three clinical tasks and many image types
A Singapore-led team has built a medical vision-language model that attempts three jobs in one system: classify disease, answer questions about an image and point to the pixels supporting its response. The peer-reviewed Nature Medicine paper, published on 29 October, reports development and testing across more than 1.3 million samples from 18 datasets. The material spans 10 imaging modalities—including X-ray, CT, MRI, ultrasound, pathology, retinal imaging and dermoscopy—and six clinical specialties.
EVLF-FM combines a disease-level encoder with a pixel-level encoder, then uses supervised and reinforcement fine-tuning to align diagnoses, locations and generated explanations. Internal diagnostic accuracy averaged 0.895 across the authors' benchmarks. For visual grounding, average accuracy at an intersection-over-union threshold of 0.5 was 0.842 across nine modalities. Those figures answer whether the model matched benchmark labels and locations; they do not tell a patient whether care became faster, safer or more accurate.[1]
External datasets broadened the test, not the clinical claim
The authors separated 13,443 samples from 17 additional datasets for external validation across the same broad modality range. They report competitive zero-shot and few-shot F1 scores despite a smaller model than several comparators. That is a meaningful guard against judging performance only on the training distribution. It is still a retrospective dataset evaluation: the paper does not describe clinicians using the system prospectively while diagnosing patients, nor does it compare decisions, time, downstream tests or outcomes with and without the model.
Dataset breadth also does not guarantee equal reliability for every disease, hospital or demographic group. Some public datasets are highly curated, while several clinical datasets were controlled-access or institution-restricted. The paper reports subgroup and robustness analyses, but prospective deployment can introduce different scanners, workflows, prevalence and missing information. A high average can conceal weak classes or sites, and an explanation that overlaps an annotated region may still be post hoc rather than the reason the model reached its answer.[1]
The distinction that matters
What the evidence does—and does not—establish
Breadth across datasets is different from prospective clinical utility.
Development
More than 1.3 million samples across 18 datasets
Diagnosis, grounding and question-answering model
External test
13,443 samples across 17 additional datasets
Broader retrospective performance check
Clinical test
Prospective use with real decisions and outcomes
Not performed; safety and utility remain open
Physicians liked the explanations; safety remains untested
Twelve physicians—four junior doctors and eight specialists in radiology, pathology and ophthalmology—graded sampled reasoning outputs using five criteria covering safety, context, objectivity, reproducibility and explainability. The overall mean was 4.25 out of 5, with a standard deviation of 0.94. This supplies a human judgement denominator, but the public article text does not turn that score into a prospective error rate, and the graders were assessing selected outputs rather than using the system across a live clinical service.
The code is public, while some source data remain restricted by privacy and governance rules. Public and academic grants funded the study; one author disclosed HealthSense funding for biomedical large-language-model research and the others reported no conflicts. The assessment would change with preregistered multi-hospital trials measuring missed diagnoses, false alarms, clinician reliance, workload and patient outcomes. Until then, EVLF-FM is a broad and carefully benchmarked research system—not evidence that one model can safely cover ten imaging modalities in routine care.[1]
Watch the background, then check the evidence
Illustrative photo · not a video frame
The Royal Society · 44 min 28 sec · Background explainer
Is this the AI future we want? | The Royal Society
YouTube loads only when you choose; playback starts when you press play.
A Royal Society discussion with Madhumita Murgia and biomedical engineer Alison Noble on AI’s potential in healthcare, science and culture, recorded at the 30 June 2026 event.
Evidence check: A discussion of opportunities and risks, including future possibilities. It is not evidence that every application described is available or clinically proven.
Published 2026-07-01. Source checked 14 October 2026. Check captions on the publisher’s video page.
Check the healthcare evidencePhoto: Daniel Sone / National Cancer Institute / Unsplash · Licence
Continue the story
Read next
Continue exploring medical imaging: compare the finding and its evidence limits.
Can this MRI model draw brain-tumour boundaries reliably?
A peer-reviewed multimodal segmentation model was developed on 2,422 public MRI volumes and externally tested on 125 cases. Accuracy remained useful but fell outside the development data; no prospective clinical workflow, radiologist comparison or patient-outcome test was performed.
Read the next reportExplore the full source and evidence record
What this means for people
- Clinicians could eventually use one system across several image types, but patients would bear the consequences of missed disease, false alarms or misplaced confidence. Those outcomes were not measured in this study.
Global context
The Singapore-led collaboration evaluated datasets from multiple settings and modalities, but deployment standards, disease prevalence and imaging workflows vary widely. Each health system would need local validation and human oversight before clinical use.
What the evidence does not yet show
- Peer reviewed
- More than 1.3 million development and test samples
- 13,443 external samples
- 17 external datasets
- 12 physician graders
- No prospective workflow test
- No patient outcomes
What to watch next
- Prospective multi-hospital trials
- Per-disease and demographic results
- Missed diagnoses and false alarms
- Clinician reliance
- Workflow time
- Patient outcomes
- Independent code reproduction
Living evidence record
Impact record IAI-0TSUVI9
Evidence stage
Studied
Confidence
Supported
Reporting basis
Source analysis
Independent or research support
Present
Record status
Monitoring
Last checked
29 October 2026
Source trail
1 direct source across 1 source type.
People impact
Documented in this record.
Uncertainty
Limits and next checks are explicit.
Stages describe the evidence available—not whether a technology is good or bad. See the public method.
Single-source reporting disclosure
This record analyses one direct source. It can establish what Nature Medicine published or reported, but it is not independent corroboration of every performance claim or predicted outcome. The confidence label will change only when broader evidence is added.
Evidence trail
Sources used for this report
Links checked 29 October 2026
Research question, topics and regions
Multimodal medical image diagnosis, visual grounding and generated explanations
Topics: Medical imaging · Foundation models · Clinical AI · Explainability · External validation
Regions: Singapore · Asia · Global
This report is labelled source analysis. We summarise and analyse source material in our own words; company statements remain attributed claims until independently supported. Translated summaries preserve the meaning of the original source and link back to it. Read our editorial standards.
Reader commentary
What does this mean where you are?
Tell us what you have seen at work, in your community or in everyday life. A question is welcome too. No account is needed; we review notes before publishing them.
Explore commentary across the portal →Published reader notes
0No published reader notes yet. You can start the evidence-led discussion above.
Prefer a private correction or response? Contact the newsroom.