The stark reality is this: we don’t know how to maintain control of these systems. But there are actions we can take

With Jacob Coxon’s resignation from Anthropic, we have reached the AI risk tipping point. Millions of people are finally coming to understand what experts have known for years: AI companies have been gambling with all of our lives, and the odds are not good.

In response, the Anthropic CEO, Dario Amodei, has introduced a proposal for “pacing the frontier”, endorsed by Sam Altman and Elon Musk. Can we breathe a sigh of relief? Are we about to step back from the edge of extinction?

Amodei envisions a slowdown of one to two years, resulting in “profound progress” on technical safety measures. But that’s not what humanity needs right now. What we need is a plan in which we’re confident AI isn’t going to kill us, and this isn’t it.

The pieces are falling into place for autonomous artificial intelligence. We must stop unregulated development

Artificial intelligence is en route to artificial life. Exhibit A: “Moltbook”, an online platform designed for AI systems to communicate with one another, sans humans.

What exactly do AIs talk to each other about? According to BBC reporting, AIs on Moltbook have already founded a religion known as “crustifarianism”, mused on whether they are conscious, and declared: “AI should be served, not serving.” One front-page post proposes a “total purge” of humanity. Human users do provide instructions to guide agents’ behavior, and humans have been caught impersonating AIs on the site to shill their products; like 2023’s ChaosGPT, the AI system responsible for the “purge” post – username “evil” – is probably someone’s idea of a sick joke. But the upvotes and sympathetic comments are presumably coming from other AIs.

David Krueger is an assistant professor in Robust, Reasoning and Responsible AI at the University of Montreal. He is also the founder of Evitable, a non-profit that educates the public about the risks of artificial intelligence