Anthropic: AI could escape human control

US firm proposes coordinated global slowdown on building advanced artificial intelligence

Anthropic’s Call for A.I. Nonproliferation

The artificial intelligence giant said a “brake pedal” was needed to protect humanity from self-improving models. The proposal could have big consequences.

By Andrew Ross Sorkin, Bernhard Warner, Sarah Kessler, Michael J. de la Merced, Niko Gallogly, Brian O’Keefe and Ian Mount

Anthropic urges ‘temporary pause’ on AI development to discuss risks

Announcement that ‘policymakers’ need to be convened by US firm viewed as marketing ploy by some experts Anthropic has floated the idea of a worldwide “temporary pause” on AI development – and said it was going to convene “policymakers” to discuss the dangers of advanced AI – in its latest release touting the capabilities of its products. In a long post on Thursday, Anthropic detailed the progress of its AI model, Claude, towards “recursive self improvement” – that is, being able to make bett...

By Aisha Down

Anthropic calls for pause of global AI development

Artificial intelligence company Anthropic suggested Thursday a global pause on building the most powerful AI systems as the latest models are beginning to show signs they could escape human control. The San Francisco-based company, which makes the Claude family of AI models, said in a report that a worldwide slowdown in cutting-edge AI development would "likely be a good thing" -- but warned that if only one company stopped, rivals would simply race ahead.

By FRANCE24

Anthropic says frontier AI labs may need to slow down so society can catch up

Anthropic's CEO Dario Amodei. Bloomberg/Getty Images Frontier AI labs are advancing systems at a hard-to-follow speed. So much so that Anthropic has called for a coordinated slowdown in AI development. "It would be good for the world to have the option to slow," the company said in a blog post. Anthropic says AI is advancing so fast that leading labs may need to slow down. In a blog post published Thursday, researchers at The Anthropic Institute, the company's research arm, said that AI is ...

Anthropic warns AI could soon build itself without human involvement—and urges a global pause on development

Anthropic warns of ‘faster than society can manage risks’ in AI advances, calls for coordinated halt in development

The call comes after a recently developed model, Mythos, sent shockwaves through industries with its ability to find vulnerabilities in existing code

Anthropic calls for pause in AI development

Anthropic is calling on ​major artificial intelligence labs to consider a coordinated and verifiable pause in ‌development, warning that rapid advances in the technology could soon allow AI systems to improve themselves faster than society can manage the risks.

Anthropic warns humans could lose control of AI, urges industry pause

Anthropic has called on leading artificial intelligence companies to establish a coordinated system for halting the development of advanced AI models if necessary, warning that rap...