Anthropic Whistleblowers Are Forcing AI's Speed Bump
Inside-the-industry defections from Anthropic are shaking Silicon Valley and pushing US lawmakers toward AI regulation—kill switches, dedicated agencies, mandatory pauses. The race to control AI may start with the people building it.
The Insiders Who Decided to Talk
Two people who helped build some of the world’s most advanced AI systems have now decided the work matters less than stopping it.
Jacob Coxson, an Anthropic researcher, left the company in September and published a public warning that AI could kill humanity within a decade — and that a loss of control could arrive by the end of next year. Four days later, fellow Anthropic expert Evan Hubinger echoed the alarm on X.
The pattern is unmistakable. Both men did not arrive at this conclusion from the outside, watching AI from a distance. They were inside the labs, reading the same capability trajectories, running the same stress tests — and deciding they could no longer stay silent.
Coxson’s claim, reported by Bloomberg and covered by Money Today, is specific enough to be alarming rather than abstract: he says the researchers building these systems genuinely believe extinction-level risk is probable, not merely possible. That distinction matters. When engineers themselves signal that “the worst case is likely,” it is no longer a philosophical exercise for ethicists.
Altman’s Private U-Turn
The internal response at OpenAI has been equally significant — and privately reported. According to Bloomberg, Sam Altman signaled in a company meeting this week that OpenAI should slow its development pace. A source told the outlet that other firms might join, though some would not.
Yakub Pachocki, OpenAI’s chief scientist, had already pushed this argument publicly, warning that no one is prepared for the consequences of rapid AI development and calling for both industry self-restraint and government regulation.
What makes this notable is the direction of travel. For years, OpenAI and Anthropic positioned themselves as the responsible alternatives to a reckless industry. Now the responsible actor is asking everyone — including itself — to take its foot off the accelerator. That is not a narrative any company chooses for itself. It is a response to internal pressure.
Washington Takes Notice
The political reaction has been swift, and it is crossing partisan lines.
Senator Ted Cruz, a Republican, said on ABC that he is drafting legislation to regulate what he called AI’s “catastrophic risk.” Representative Ro Khanna, a Democrat, has pushed for a new federal AI regulatory agency and publicly supported a “kill switch” — a mechanism to force-stop AI systems deemed dangerously misaligned.
The Wall Street Journal reported that if Democrats gain control of Congress in the November midterms, a dedicated AI special committee is under consideration. The timeline is tight: these conversations are happening months before any election outcome is settled.
Sam Silverman, a technology and political communications advisor, told Money Today that most politicians had never heard these warnings directly from a researcher. This time is different. “For the first time,” he said, they are hearing it from the people actually doing the work.
That framing — credibility transferred from technical authority to political will — is the mechanism that turns an industry debate into a policy debate.
The Divide Inside the Industry
Not everyone agrees the brakes should be applied.
Google and Meta continue to invest heavily in data center infrastructure and compete for talent. Their stance, implicitly, is that capability acceleration is the priority and that regulatory caution cedes ground to competitors — particularly China.
Donald Trump has taken a mixed position. He has expressed support for a kill switch on dangerous AI systems, but has also warned that excessive regulation could weaken America’s competitive edge in the AI race against Beijing.
This is the core tension: the same geopolitical logic that drove the current arms race in compute and models is now being used to justify slowing that same race. The question regulators face is whether a pause is even feasible when the alternative is being left behind.
What Happens Next
Three scenarios are worth watching.
The first is a voluntary industry pause — similar to the COVID-era lab safety debates — where leading labs agree to slowdowns. This is what Altman appears to be pushing for internally. But without legal enforcement, it is only as strong as the companies’ willingness to honor it. Google and Meta have shown no sign of committing.
The second is legislative action. A federal AI regulator with a kill switch would represent the most dramatic shift in US tech policy in decades. The infrastructure would need to be built, the legal authority defined, and the threshold for activation established — all before the next generation of models ships. The November midterms could determine whether there is a Democratic mandate to move quickly.
The third is fragmentation. The EU has AI Act enforcement underway. China is developing its own AI governance framework, focused on control and stability rather than safety in the Western sense. The US, if it moves slowly, risks creating a regulatory gap that becomes a competitive gap — exactly the scenario both Trump and Khanna are worried about.
Why This Matters Beyond Washington
The Coxson-Hubinger warnings carry weight because they come from people with access to information the public does not. They are not speculating about hypothetical future systems. They are reacting to capabilities they helped create.
If their assessment is correct — and no one can yet say definitively whether it is — then the current competitive framework is structurally misaligned. It rewards speed and punishes caution. The firms that hold back lose talent, lose market share, and lose geopolitical influence.
The alternative is a coordination mechanism — whether through regulation, industry agreement, or international treaty — that makes slowness a credible strategy.
That conversation has just begun. The people inside the labs are the ones pushing it forward.
Whether policymakers listen — and whether the market allows it — remains the open question.