A week after CEO Dario Amodei publicly called for the AI industry to slow down, Anthropic has taken its first real, concrete step to prove it meant it. On Friday, September 18, Anthropic announced a partnership with Accenture, giving the consulting giant’s specialist AI unit employee-level access inside Anthropic’s own model development process, the first real-world implementation of a promise that, until now, existed only on paper.
What This Partnership Actually Does
Announced directly on Anthropic’s own site, the deal will see Accenture’s AI safety unit, Faculty, place evaluators inside Anthropic with access comparable to Anthropic’s own staff. That’s a meaningful departure from how AI safety testing has traditionally worked. Where external evaluators typically only see a model’s finished outputs after the fact, embedded evaluators will reportedly watch models take shape during training itself, follow the actual decisions that govern how those models get built and deployed, and speak directly with Anthropic employees throughout the process.
Anthropic described the scope of the work as including model evaluation and red-teaming, alignment assessments, and safeguard testing, essentially, a standing team whose entire job is probing Anthropic’s own models for problems from the inside, rather than reviewing a finished product from the outside.
Both companies have committed to investing at least $1 billion each into the effort over the next five years, a combined $2 billion bet that treats safety evaluation as a genuine, funded engineering discipline rather than a one-time audit or a PR gesture.
Where This Idea Actually Came From
The partnership is the first concrete step toward a proposal Amodei laid out just six days earlier, in a lengthy essay titled “We Must Pace the Frontier.” In it, Amodei argued the AI industry needs to deliberately slow the pace at which it improves model capabilities, and outlined a three-part framework for doing it, starting with exactly this, giving independent evaluators “ongoing, employee-like access” to verify safety practices and report incidents in real time.
Amodei explicitly said Anthropic was “unilaterally committing” to this first step regardless of what competitors chose to do, and encouraged other frontier labs to follow suit. Friday’s announcement is that commitment turning into an actual, funded, named partnership rather than just a stated intention.
Why Accenture Specifically
Anthropic pointed to Accenture’s existing track record helping businesses and governments deploy AI responsibly across a wide range of industries as the reasoning behind the pick. Faculty, the specific Accenture unit doing the embedded work, had already been active in AI safety before this deal, and its CEO, Dr. Marc Warner, is now also serving as Accenture’s Chief Technology Officer. Warner has framed the underlying philosophy behind the work simply: AI should be “safe by design, not safe by accident.”
Anthropic was also careful to note this isn’t an exclusive arrangement. The company said it plans to announce additional embedded evaluators beyond Accenture in the coming weeks, specifically to avoid depending on a single outside evaluator’s perspective.
The Honest Caveats Here
Anthropic itself has acknowledged that embedded evaluation is a genuinely new practice, and that many of the operational details, exactly how much access evaluators get, what the reporting process looks like when something concerning turns up, and how independence gets preserved once evaluators are effectively working inside the building, are still being figured out as the partnership gets underway.
That’s a fair point worth sitting with. A truly independent watchdog that’s also financially entangled with the company it’s watching, and physically embedded inside its offices, raises a real structural question, can evaluators stay genuinely independent when they’re this close to the organization they’re evaluating? Anthropic hasn’t fully answered that yet, only that it intends to keep expanding the number of evaluators involved as one way to guard against that risk.
The Bottom Line
Whatever the eventual verdict on how well embedded evaluation actually works in practice, this is a genuinely rare moment, a major AI lab converting a public safety promise into a funded, named, operational program within a single week. Whether other frontier labs follow Anthropic’s lead on this specific model, or push back the way Nvidia’s Jensen Huang has publicly done on the broader “pace the frontier” framing, will likely shape how seriously the rest of the industry takes this particular experiment.
You can read Anthropic’s full announcement directly on Anthropic’s official site.
For more on the essay that started all of this, read our coverage of Dario Amodei’s call for AI labs to slow down.
1 Thought
Steve Page
[…] more on how the industry is responding to this exact pattern, read our coverage of Anthropic’s new partnership with Accenture on embedded AI safety evaluation and Dario Amodei’s call for AI labs to slow […]