Anthropic gave six METR staff internal access—what can they publish?
The outside evaluators can use employee-grade systems and publish without a company veto, Anthropic says. But exclusions, redaction rules and company-controlled classification leave the arrangement short of public oversight.
The short version
3 key points
- 1.Six METR employees now have Anthropic hardware, office space and access to internal tools and systems broadly comparable with the company's risk-assessment teams.
- 2.Anthropic says it cannot veto publication, but it can require redactions in predefined categories and makes the final classification decision; METR may disclose resulting access limits.
- 3.No assessment from the arrangement has yet demonstrated safer models or practices. This is a voluntary access agreement, not regulatory inspection or proof of independence.
The access is unusually deep, but not unlimited
Anthropic says six employees of the nonprofit evaluator METR are now working with hardware, office space and internal tools roughly comparable with those used by its own risk-assessment teams. The embedded group may study model risk levels, incidents and company practices. Customer data, attorney-client privileged material and model architecture remain outside the arrangement. Anthropic says it cannot veto a METR publication, although it may require redactions within agreed categories and retains the final decision over classification. METR can say when those limits affected its access or reporting.[1][2]
Why the publication terms matter
For researchers, policymakers and people affected by frontier systems, the value is not proximity alone: it is whether evaluators can disclose consequential failures and unresolved disagreements. METR says it accepts no compensation for model-evaluation work, while developers provide model access and inference tokens. That reduces one financial conflict but cannot remove operational dependence on Anthropic's systems, security decisions and continuing cooperation. The arrangement is stronger than a narrow pre-release test, yet still voluntary and controlled by a company being assessed.[1][2]
Who it affects
Workers, customers and communities cannot inspect frontier systems themselves; they benefit only if outside assessors can surface material risks clearly enough for companies and public authorities to act.[1][2]
Keep in mind
The available evidence is the parties' description of a new voluntary arrangement. There is no completed assessment, independent audit of the access provided, public redaction record or measured safety outcome yet.
Multi-source analysis · 2 linked sources. Original source date: 15 October 2026.
Read more The full report, methods and context
The access is unusually deep, but not unlimited
Anthropic says six employees of the nonprofit evaluator METR are now working with hardware, office space and internal tools roughly comparable with those used by its own risk-assessment teams. The embedded group may study model risk levels, incidents and company practices. Customer data, attorney-client privileged material and model architecture remain outside the arrangement. Anthropic says it cannot veto a METR publication, although it may require redactions within agreed categories and retains the final decision over classification. METR can say when those limits affected its access or reporting.[1][2]
Why the publication terms matter
For researchers, policymakers and people affected by frontier systems, the value is not proximity alone: it is whether evaluators can disclose consequential failures and unresolved disagreements. METR says it accepts no compensation for model-evaluation work, while developers provide model access and inference tokens. That reduces one financial conflict but cannot remove operational dependence on Anthropic's systems, security decisions and continuing cooperation. The arrangement is stronger than a narrow pre-release test, yet still voluntary and controlled by a company being assessed.[1][2]
The distinction that matters
Where evaluator independence is gained—and constrained
The agreement expands what METR can inspect, while reserving defined controls for Anthropic.
Access
Six METR staff use internal systems and workspace
More evidence than an external API-only test
Publish
METR writes its own assessments without an Anthropic veto
Findings can be released after required review
Limits
Anthropic excludes some data and makes final classification decisions
Redactions and access gaps still shape the public record
What the announcement establishes—and what it does not
Anthropic presents the METR arrangement as its highest of three evaluator-access tiers. The lower tiers include scheduled access for organisations such as SecureBio, Accenture and Faculty, and more limited evaluations by groups with their own methods. That structure may help outside specialists follow a model through development rather than testing a single release, but the announcement supplies no completed METR report, disclosure log or example showing how a contested redaction was resolved.
The company updated its announcement on 16 October to clarify the terms, one day after publication. The original 15 October date remains the source date. A credible test will be whether METR publishes specific findings, names important access gaps, separates company claims from its own judgements and can continue reporting after a critical result. External replication and regulator access would add safeguards that a bilateral agreement cannot provide. Until those outputs appear, this is evidence of expanded access—not evidence that Anthropic's systems are safe or that evaluator shopping has been solved.[1][2]
Watch the background, then check the evidence
The Royal Society
YouTube loads only when you choose. Press play in the player to start. If playback is unavailable, use “Watch on YouTube” below.
AI basics · Background explainer
Published 2018-11-28 · 2 min 31 sec
What is artificial intelligence? | The Royal Society
A short introduction to artificial intelligence from the Royal Society. Start here for basic concepts, then use current reporting to explore what has changed.
Evidence check: Published in 2018, before today’s generative AI tools. Useful for basic concepts, rather than an overview of current capabilities.
Source checked 14 October 2026. Check available captions on the publisher’s video page.
Evidence check
The available evidence is the parties' description of a new voluntary arrangement. There is no completed assessment, independent audit of the access provided, public redaction record or measured safety outcome yet.
Reporting basis: Multi-source analysis. Original source date: 15 October 2026.
Explore the full source and evidence record
What this means for people
- Workers, customers and communities cannot inspect frontier systems themselves; they benefit only if outside assessors can surface material risks clearly enough for companies and public authorities to act.
Global context
The agreement is between two US organisations, while frontier models are deployed internationally. It does not replace legal powers, locally accountable oversight or evaluation across languages and jurisdictions.
What the evidence does not yet show
- The available evidence is the parties' description of a new voluntary arrangement. There is no completed assessment, independent audit of the access provided, public redaction record or measured safety outcome yet.
What to watch next
- METR's first embedded assessment; disclosure of access restrictions and redactions; evidence that Anthropic responds to findings; comparable access for other independent evaluators and public regulators.
Living evidence record
Impact record IAI-1X6R5OE
Evidence stage
Announced
Confidence
Supported
Reporting basis
Multi-source analysis
Independent or research support
Not yet
Record status
Monitoring
Last checked
17 October 2026
Source trail
2 direct sources across 2 source types.
People impact
Documented in this record.
Uncertainty
Limits and next checks are explicit.
Stages describe the evidence available—not whether a technology is good or bad. See the public method.
Evidence trail
Sources used for this report
Links checked 17 October 2026
Research question, topics and regions
Topics: Independent evaluation · Frontier AI · Model safety · Transparency · Governance
Regions: United States · North America · Global
This report is labelled multi-source analysis. We summarise and analyse source material in our own words; company statements remain attributed claims until independently supported. Translated summaries preserve the meaning of the original source and link back to it. Read our editorial standards.
The Impact Brief · Free
Keep following the stories that matter to you.
Get our weekday briefing on what changed and why it matters. Choose your topics below.
Continue the story
There’s more to this story
AI Risks & Safety
Can AI agents learn what is appropriate?
Perhaps, but the new Google-led report is a research agenda, not a tested safeguard. More than 50 contributors propose contextual policy engines, dynamic sandboxes and multi-agent benchmarks without demonstrating that they prevent real privacy or security failures.
3 min · 2 sources
AI Risks & Safety
Can a driving AI refuse an unsafe instruction?
In new simulated-driving tests, a model designed to reason about conflicts cut collisions from 60 to 38 versus the strongest safety-prompted baseline. The manuscript does not establish public-road safety or a formal guarantee.
2 min · 1 source
AI Risks & Safety
Will a medical AI resist a forged document that contradicts a scan?
Four open vision-language models often abandoned correct radiology answers after scripted pressure, even when they said the fake prescription was invalid. The experiment was synthetic and does not measure deployed clinical systems.
2 min · 1 source
Reader commentary
What does this mean where you are?
Tell us what you have seen at work, in your community or in everyday life. A question is welcome too. No account is needed; we review notes before publishing them.
Explore commentary across the portal →Published reader notes
0No published reader notes yet. You can start the evidence-led discussion above.
Prefer a private correction or response? Contact the newsroom.