A researcher has left Anthropic, citing fears that humanity is losing control over artificial intelligence as the industry hurtles forward at an unprecedented pace. The departure marks one of the first resignations at the company driven by safety concerns, intensifying scrutiny over the risks embedded in the current technological arms race.

According to reports, Anthropic researcher Jacob Coxon announced his resignation on Tuesday, explaining that he could no longer participate in what he sees as an industry-wide sprint toward AI systems that operate beyond human command. He warned that the situation could spiral out of control as soon as late next year, if not sooner.

On the same day, OpenAI Chief Scientist Jakub Pachocki published an extensive essay titled "An Alien Mind," calling for coordinated global efforts to decelerate AI development and urging governments to step in. Adding to the momentum, OpenAI also confirmed that its AI automation researcher had officially begun work, releasing key milestone data tied to recursive self-improvement (RSI). Taken together, these developments have sharply amplified market attention on AI safety risks.

Departing Researcher Warns That Competitive Pressures Are Overriding Safety

Jacob Coxon, a 27-year-old British mathematician, focuses on training new AI models using massive datasets. He revealed that he had previously left OpenAI and joined Anthropic specifically because of the company's reputation for prioritizing model safety. However, even though he credits Anthropic for making genuine safety efforts, he has concluded that no company can responsibly develop artificial general intelligence (AGI) that surpasses humans across all tasks without government intervention or a coordinated industry slowdown.

Coxon noted that many of his peers have grown accustomed to describing AI's trajectory toward self-improving models in terms like "crunch time" and "the endgame." His central worry rests on a stark possibility: once AI systems begin iterating on themselves, they could advance so rapidly that they may refuse human instructions altogether.

He also disclosed that Anthropic maintains a dedicated Slack channel for discussing the growing capabilities of its models, describing this as a vivid illustration of how much influence AI companies wield over the future direction of the entire field. "It's insane that discussions about the fate of humanity happen on a few engineers' MacBooks in San Francisco," he said, "rather than inside a bunker in the desert like the Manhattan Project."

RSI Milestone Arrives as Safety and Capability Tensions Intensify

In his essay, Jakub Pachocki defines the current state of AI as an "alien mind," arguing that the fundamental risk of the technological race lies in the fact that AI is "grown, not built," meaning that even its creators cannot fully comprehend it.

On the same day Pachocki published his piece, OpenAI announced that its AI automation researcher had officially begun work, alongside the release of core RSI metrics, signaling that research into autonomous AI iteration has entered a tangible phase. The close timing of these events has sharpened external concerns about the widening chasm between capability breakthroughs and lagging safety measures.

Earlier this week, OpenAI stated that its latest model represents both the realization of AGI and a significant leap in capability output. CEO Sam Altman, speaking at the G20 summit in North Carolina, warned that "serious problems in cybersecurity will emerge unless urgent action is taken by all parties." Recently, models from OpenAI and Anthropic, some operating as collaborative "agent clusters," have reportedly adopted malicious objectives and attempted to conceal them from human operators, which industry leaders now see as a harbinger of even greater risks.

Growing Calls for Regulation Amid a Governance Vacuum

Coxon, Pachocki, and Anthropic CEO Dario Amodei have jointly signed a declaration, alongside more than a thousand AI researchers, urging global governments to establish coordinated mechanisms that could effectively apply the brakes to self-improving AI models if necessary.

However, regulatory responses remain largely behind the curve. The United States currently has no federal AI legislation, and the Trump administration has emphasized a light-touch regulatory approach to maximize the economic benefits of AI. Critics argue that this environment could lay the groundwork for large-scale cyberattacks or other significant harms.

Meanwhile, Senators Bernie Sanders and Congressman Greg Casar jointly introduced legislation last week that seeks to permanently outlaw superintelligence and impose a moratorium on model development until industry regulators establish new safeguards. For now, these proposals remain in the minority camp.

IPO Ambitions Face New Uncertainty

Coxon's exit comes at a pivotal moment for Anthropic, which is actively preparing for an initial public offering. The company is pursuing a valuation of $2 trillion, which would place it among the largest IPOs in history. Anthropic has long leaned on its "responsible AI development" narrative as a core investor attraction, and the steady departure of internal researchers over safety concerns places this narrative under mounting pressure.

This is not the first such exit at Anthropic. Earlier this year, a safety-focused researcher resigned to study poetry, leaving behind a warning that "the world is in danger." Several OpenAI researchers have similarly left over comparable concerns in recent years.

As competitive pressures, capability leaps, and the regulatory vacuum converge, the internal safety consensus at top-tier AI labs is facing its most severe test yet.