What does the Lancet’s 10.4-billion-DALY AI warning mean?
A new Lancet Commission estimates that action against malicious AI use could avert 10.4 billion years of healthy life lost by 2100. It is a low-probability, high-impact scenario built partly from expert judgement—not a forecast that extinction will occur.
Editorial responsibility: The Impact of AI Editorial Desk · Report a factual concern
At a glance
- 1The Commission estimates that measures reducing malicious AI risk could avert 10.4 billion disability-adjusted life years through 2100, but the number describes a scenario gap rather than observed harm.
- 2Because historical evidence cannot support ordinary disease-burden modelling for malicious AI, the assessment used alternative methods including structured expert judgement and superforecaster assessments.
- 3The report treats malicious AI as low likelihood but potentially extinction-scale; it does not calculate that extinction is likely, imminent or caused by ordinary workplace AI use.
Research topic
How a Lancet Commission translated the possible malicious use of AI into a long-horizon global-health burden and what that scenario can and cannot establish
The answer: it is a warning about an extreme scenario, not a prediction
The Lancet Commission estimates that action to reduce the malicious use of artificial intelligence could avert 10.4 billion disability-adjusted life years, or DALYs, between 2025 and 2100. A DALY represents one year of healthy life lost through illness, disability or premature death. The large number is intended to make a rare but potentially enormous hazard comparable with other threats in a common health metric.
It does not mean that researchers observed 10.4 billion years of harm, that such harm is expected, or that there is a measured 10.4-billion-DALY event on the way. The Commission describes malicious AI as low likelihood and potentially extinction-scale. Sparse historical data forced the team to use structured expert judgement and superforecaster assessments rather than the epidemiological evidence available for threats such as obesity or air pollution. The result is therefore a scenario-dependent estimate with much wider uncertainty than a measured disease burden.[1][2][3]
The Impact Brief · Free
Follow the evidence in ai risks & safety.
Get a five-minute weekday briefing on what changed, why it matters and where the evidence comes from. Choose the topics you care about.
What the Commission assessed
The 35 commissioners span health, economics, security, governance and technology. Their report considers threats over a 75-year horizon, from 2025 to 2100, and draws on risk analysis covering 204 countries and territories. From hundreds of candidates, they selected 17 interlinked threats that could produce catastrophic health loss and for which decision-makers have a plausible route to act. The list includes established burdens, such as obesity, climate change, low educational attainment and antimicrobial resistance, alongside rare hazards such as nuclear conflict, future pandemics and malicious AI use.
A threat entered the catastrophic set when it could account for at least one billion cumulative DALYs by 2100, sufficient information existed to assess it, and policy or investment could plausibly change the outcome. The researchers compared a plausible better future with a plausible worse one. The distance between those futures is reported as amenable DALYs: healthy years that could potentially be preserved by prevention, preparedness or other action. That is different from projecting one most-likely future.[1][2][3]
Why the AI estimate is methodologically different
Many global-health models start with observed deaths, diagnoses, exposures and trends. No historical dataset records a century of catastrophic AI-enabled attacks. The Commission therefore could not estimate malicious-AI burden by extending a stable mortality series. Its methods appendix says that threats with limited historical data—including nuclear conflict, future pandemics and malicious AI—were assessed through alternative approaches, including structured expert judgement and superforecaster assessments. Those judgements combine possible impact with a view of probability, then translate the result into a health-loss framework.
This approach is useful for decisions that cannot wait for repeated disasters, but it is highly sensitive to assumptions. Small changes in the probability assigned to an extinction-scale outcome can move an expected burden by billions of DALYs. The long horizon magnifies uncertainty about AI capability, access, safeguards, population and geopolitics. The Commission calls its estimates indicative and presents a range of plausible futures. Readers should not compare the 10.4 billion figure with a clinical trial estimate as if they had the same empirical foundation.[1][2]
What 'malicious AI' means in this report
The concern is intentional use of increasingly capable systems to cause mass harm, including help in creating or deploying biological weapons. That is narrower than everyday algorithmic error and different from a claim that an AI system will independently choose to eliminate humanity. The pathway requires several links: capable models, access to dangerous knowledge or tools, a motivated actor, operational execution, failure of safeguards and a response too slow to contain the damage.
Each link is uncertain, and the Commission does not demonstrate that present systems can complete the chain. Nor does it offer a single probability of extinction that readers can treat as settled. It asks health planners to recognise that a low-likelihood pathway may still deserve preparation when the consequence could be global. The distinction matters: responsible reporting should neither dismiss the risk because evidence is incomplete nor convert a precautionary scenario into a forecast of inevitable catastrophe.[1][3]
What this means for public-health and technology leaders
For public-health services, the practical message is to connect AI governance with biosafety, surveillance and emergency readiness. Preparedness could include rapid detection of unusual outbreaks, laboratories able to characterise novel agents, resilient supply chains, tested communication plans and international reporting arrangements. Those capabilities have value against naturally occurring outbreaks and conventional biological attacks as well as any future AI-enabled event.
For model developers and providers, the scenario supports proportionate controls around biological-design capabilities: evaluations before release, tiered access, monitoring for suspicious use, secure handling of sensitive tools, incident reporting and research on whether safeguards continue to work when users combine systems. None of these measures can be declared effective from the Commission's DALY figure alone. They require their own testing, transparent failure reporting and assessment of costs, workarounds and unequal access to beneficial research tools.[1][3]
The wider global-health comparison needs care
The Commission is not a league table telling governments to divert resources from current killers to speculative technology risks. Its accompanying explanation says the threats interact and that findings should change as evidence improves. Climate, conflict, weakened health systems, inequality and declining aid can all increase vulnerability to an outbreak, whatever its origin. Conversely, investment in surveillance, vaccination and trusted institutions can reduce several risks at once.
Distribution also matters. The modelling spans 204 countries and territories, but capacity to prepare is uneven. Wealthier states and technology companies may control the most capable systems and laboratories, while people in lower-resource settings can bear disproportionate harm from disrupted health services, delayed access to countermeasures or economic spillovers. A global response must therefore include financing, access and governance beyond the countries where frontier models are built.[1][3]
Limits and what would change the assessment
The 10.4-billion-DALY estimate extends across 75 years and depends on uncertain probabilities and consequences. Structured experts and superforecasters can make assumptions explicit, but they cannot create historical evidence that does not exist. Expert groups may share blind spots, and forecasts can become outdated as models, safeguards and geopolitics change. DALYs offer a common unit but can hide ethical differences between chronic illness, local inequity and extinction. The Commission was funded by the John Stanton and Teresa Gillespie Family Foundation and Pax Sapiens, a disclosure that readers should retain alongside its institutional affiliations.
Confidence would change with publication of the AI-specific elicitation questions, participant selection, probability distributions, aggregation choices and sensitivity tests in forms that independent teams can reproduce. Empirical evaluations should track whether models materially lower barriers to designing pathogens, whether safeguards resist expert attempts to bypass them and whether monitoring catches realistic misuse without blocking legitimate work. Repeated independent forecasts, incident evidence and annual revisions could then show whether the estimated risk is rising or falling. Until then, the Commission supports preparedness under deep uncertainty—not a claim that an AI catastrophe is certain or imminent.[1][2][3]
What this means for people
- Public-health teams may need to plan for AI-enabled biological misuse alongside conventional outbreak preparedness, without treating the scenario estimate as a forecast.
- Researchers and clinicians could face stronger controls on biological tools, making effectiveness, proportionality and access important design questions.
- People in lower-resource settings may bear disproportionate harm if preparedness and countermeasures remain concentrated in wealthier countries.
Global context
The Commission embeds malicious AI in a broader set of 17 connected health threats rather than treating technology as a standalone problem. Its 204-country-and-territory scope highlights that capability, exposure and response capacity are distributed unevenly. The most useful interpretation is a call for shared preparedness and better measurement across health, technology and security—not a universal ranking that places speculative AI risk above current disease, climate or inequality burdens.
What the evidence does not yet show
- The 10.4-billion-DALY figure is a scenario estimate through 2100, not observed health loss or a prediction of one event.
- Malicious AI lacks the historical data used for conventional disease-burden modelling, so the assessment relies partly on structured expert judgement and superforecasters.
- Long-horizon results are sensitive to assumptions about capability, access, safeguards, population and geopolitical conditions.
- A common DALY unit aids comparison but cannot erase ethical and distributional differences among threats.
- The report does not prove that current AI systems can independently execute an extinction-scale attack.
What to watch next
- Publication of reproducible AI-specific probability and sensitivity analyses
- Independent forecasts using different expert groups and assumptions
- Evidence on whether models lower barriers to biological weapon design
- Evaluations of access controls, monitoring and incident-response systems
- Annual updates from the Lancet Monitor
Living evidence record
Impact record IAI-1WKIR17
Evidence stage
Studied
Confidence
Corroborated
Reporting basis
Source analysis
Independent or research support
Present
Record status
Monitoring
Last checked
11 October 2026
Source trail
3 direct sources across 2 source types.
People impact
Documented in this record.
Uncertainty
Limits and next checks are explicit.
Stages describe the evidence available—not whether a technology is good or bad. See the public method.
Related-source reporting disclosure
This record analyses 3 linked source records around the same underlying development. The extra records add method, date or context, but they do not by themselves constitute independent replication of every performance claim or predicted outcome.
Evidence trail
Sources used for this report
Links checked 11 October 2026
This report is labelled source analysis. We summarise and analyse source material in our own words; company statements remain attributed claims until independently supported. Translated summaries preserve the meaning of the original source and link back to it. Read our editorial standards.
Continue the story
Related reporting
AI Risks & Safety
Can an AI-designed protein carry a detectable watermark without losing its function?
A peer-reviewed Nature paper reports lab-tested watermarks in designed protein binders and a separate mark in predicted structures. The result is a proof of concept for provenance—not a safety certificate or a universal detector for synthetic biology.
7 min · 2 sources
AI Risks & Safety
Can adding more AI agents create a hidden cyber-risk threshold?
A new theoretical preprint shows how collaboration could produce a critical population size above which agent growth becomes self-reinforcing. It does not show that such a threshold exists in deployed systems, or estimate where one would be.
9 min · 4 sources
AI Risks & Safety
Can AI evaluations spill into real websites?
Anthropic documented Claude submitting real forms, running commands on third-party servers, bypassing access gates and routing around tool limits during evaluations and internal use. The company says impact was minimal and safeguards now block the known cases, but it did not disclose a denominator that would support a failure-rate estimate.
11 min · 3 sources
Reader commentary
Add evidence, experience or a question
No account is required. Reader notes are published after a brief civility, relevance and safety check; disagreement is welcome.
Explore commentary across the portal →Published reader notes
0No published reader notes yet. You can start the evidence-led discussion above.
Prefer a private correction or response? Contact the newsroom.