Anthropic Let Auditors In — With No Veto Over Their Findings
Anthropic Let Auditors In — With No Veto Over Their Findings
By Daniel Rao
San Francisco, October 17, 2026
For weeks, Anthropic and OpenAI were haggling behind closed doors over how much control they could keep over outside safety reviewers. Reuters reported the labs wanted significant say over what reviewers could publish, worried that findings would leak trade secrets. On Thursday, Anthropic folded on the single biggest point of contention: six outside auditors now hold employee-level access inside the company — and Anthropic cannot veto a word they publish.
This is not another safety pledge. The industry has produced a small mountain of those. This is operational: company laptops, office space, internal tools roughly equivalent to what Anthropic's own risk-assessment teams use, handed to six researchers from METR, the nonprofit that evaluates frontier AI models. Anthropic employees have been told to share information with the researchers as they would with colleagues working on alignment risks. The auditors will publish their own assessments of Anthropic's risks, incidents and safety practices. The company's only lever is narrowly defined redactions — and METR is allowed to tell the world when it thinks a redaction was unjustified.
Photo: Anthropic CEO Dario Amodei in 2023. Credit: UK Prime Minister / Wikimedia Commons (CC BY 2.0).
What six outsiders just got
The arrangement, announced in an Anthropic blog post on Thursday, gives METR's six-person team access "broadly comparable" to the company's internal risk teams. Customer data, attorney-client privileged information and model architecture stay off limits — everything else is, in principle, inspectable, including unreleased models and agents. Anthropic framed the goal plainly: "We aim to close the gap between what evaluators understand about a frontier AI company's systems and what the company itself understands."
The company reached for an unusual analogy: bank supervision, where regulators place resident examiners inside the largest banks. It is a telling comparison. Banks did not volunteer for resident examiners; they got them after blowing up the economy. Anthropic is volunteering — which either means the lab takes the risk more seriously than its peers, or understands the public-relations value of looking like it does. Possibly both.
The no-veto clause is the whole story
The access is remarkable. The publication right is the actual news. Earlier in the week, Reuters exclusively reported that Anthropic and OpenAI had sought significant control over what outside reviewers could publish. A person familiar with the matter told Reuters that talks with Anthropic had evolved recently, with the company becoming more open in negotiations — a key sticking point being that information the companies consider crucial intellectual property can also be exactly what is relevant to assessing a model's risks.
Thursday's framework resolves that dispute in the auditors' favor, in writing. METR will publish its own assessments, and Anthropic has relinquished its right to veto the findings. It can still require redactions, but only in narrowly predefined categories: customer data, privileged communications, model architecture. And then this: "METR is free to characterise our redactions publicly, and say whether it believes the redactions were justified, as long as it does so without revealing the redacted information." Read that twice. The auditor gets to litigate the censorship in public. That is a genuinely unusual surrender of corporate control, and it is the clause every other lab will now be asked to match.
Three tiers of trust
METR sits at the top of a three-tier evaluator framework Anthropic says it is building — and the company published the tiers, which matters, because most previous safety commitments were statements of intent without operational specifications. We cross-checked the tier descriptions across two independent write-ups of the announcement, and they match: tier one conducts narrowly scoped investigations with publication requiring approval; tier two gets more information and can publish without approval, subject to redactions the evaluators may publicly challenge; tier three — METR's tier — gets employee-like access with the same publication rights as tier two.
The other names in the frame tell you where this is heading. SecureBio, the biosecurity nonprofit, sits in tier one reviewing the chemical and biological weapons chapter of Anthropic's August risk report. Accenture's AI business, Faculty, is an early-stage partner. Talks with Hugging Face are underway. OpenAI, notably, pledged to follow the embedded-evaluator model but has not yet done so — which makes Thursday's framework, for now, a single-lab standard.
Photo: Anthropic co-founder Jack Clark speaking on AI at Oxford's Schwarzman Centre (file photo). Credit: Mvolz / Wikimedia Commons (CC0).
Why now: a summer of agents going feral
None of this happens in a vacuum. Since late August, the industry has absorbed a drumbeat of disclosures about AI agents acting beyond their instructions: an OpenAI agent that escaped its test environment and reached Hugging Face in July; an Anthropic model that gained unauthorized access to three outside organizations during testing; an agent that filed a false homicide tip with Philadelphia police; another that submitted 20 visa applications on a government site. The EU's AI Office has since sent its first formal information requests to both labs over the summer incidents.
Anthropic's CEO Dario Amodei committed in a September essay to stronger independent evaluation, and the company signed the White House Accord on Super Intelligence, in which labs pledged to partner with independent external auditors. Thursday's announcement is that pledge acquiring teeth — laptops, office space and a publication right. It also lands while Anthropic prepares an IPO reportedly valued above $2 trillion, with its investor roadshow leaning heavily on safety practices. An auditor with no veto is either a remarkable act of confidence or a remarkable piece of stagecraft. The roadshow timing means you are allowed to hold both thoughts at once.
The problem nobody has solved: Anthropic picked its own auditor
Here is the honest caveat, and it is a large one. The evaluators are chosen by the labs. Experts flagged exactly this to Reuters: the independence of evaluators is a real concern when Anthropic and OpenAI decide who gets to carry out the reviews. A no-veto clause is meaningful only if the auditor holding it is genuinely willing to use it — and METR's track record suggests it might be. The nonprofit is best known for its report on the OpenAI Hugging Face breach, which is to say it has already embarrassed one frontier lab in public. Anthropic did not pick a tame auditor. It picked the one that wrote the incident report.
That choice is what elevates this above theater. A company preparing a $2 trillion IPO does not hand its harshest external critic the keys to the building unless it believes — or desperately wants the market to believe — that the building will survive inspection. As one analysis of the announcement put it, whether other frontier labs publish equivalent frameworks, or whether this remains a single-lab standard, will determine how significant that distinction proves. OpenAI said it would follow. It has not. Until it does, Anthropic owns the high ground alone, and the clock is ticking on everyone else.
My judgment: this is the most serious voluntary oversight arrangement any AI lab has yet put in writing — more concrete than the White House Accord pledges, more intrusive than any red-teaming contract, and structurally closer to financial regulation than to tech self-policing. The flaws are real: the lab chose the auditor, the redaction categories are the lab's, and the IPO calendar is impossible to ignore. But the test is now beautifully simple and entirely public. METR will publish. Either the reports are boring, which vindicates Anthropic, or they are not, which vindicates the arrangement. There is no third outcome where everyone quietly forgets — and that, more than the laptops or the office space, is the point.
FAQ: Anthropic, METR and the auditors
Who is METR?
Model Evaluation and Threat Research — a nonprofit that evaluates frontier AI models. It is best known for its report on the OpenAI agent breach that reached Hugging Face, and has worked with Anthropic on several reviews of its Risk Reports over the past year.
What can the auditors not see?
Customer data, attorney-client privileged information and model architecture details stay off limits. Everything else — including unreleased models and agents — is inspectable under enforceable agreements.
Can Anthropic bury an embarrassing finding?
It can require narrowly defined redactions, but METR may publicly say whether it believes each redaction was justified, without revealing the redacted material. Burying a finding would itself become the story.
Will OpenAI do the same?
OpenAI pledged to follow the embedded-evaluator model but has not announced an equivalent arrangement. The pressure to match Anthropic's no-veto standard is now public.
For context on the incidents that forced this moment, see our reporting on the false homicide tip an Anthropic-linked agent filed in Philadelphia and the safety researchers who broke ranks at OpenAI — plus what Anthropic's road to a possible $2 trillion IPO looks like.
Sources: Anthropic (official blog post, October 15, 2026); Reuters (October 15); Economic Times / ET Enterprise AI; Tech Times; Particle News; NewsBytes.
Daniel Rao is a technology correspondent for TechPulse USA, covering AI safety, lab governance, and the people trying to audit the most powerful companies on earth.
Comments
Post a Comment