ComputerWorld AI·
AI could soon lead to systems capable of improving their own performance faster than humans can effectively supervise them, reviving concerns about the industry’s longstanding “alignment problem,” ensuring AI systems reliably pursue human goals, senior Anthropic researchers have warned in a new blog post titled “When AI builds itself.” Anthropic Institute lead Marina Favaro and Anthropic co-founder Jack Clark outlined three possible futures: growth in AI capabilities may flatten out; AI efficiency gains may continue to grow, but expose bottlenecks elsewhere in software development; or AI systems may become capable of full recursive self-improvement, and build their successors by themselves. It’s that third scenario that’s prompting them to suggest society be ready to hit the brakes on AI development. “How the alignment problem gets solved — or not — in this future is something we are least certain about,” they wrote. Advanced, self-improving models could follow our needs and wants — or
Read full articleAnthropic calls for a coordinated pause in frontier AI development as it warns recursive self improvement could outpace oversight. The post Anthropic urges top AI labs to slow development over self-improvement risks appeared first on Crypto Briefing.
Announcement that ‘policymakers’ need to be convened by US firm viewed as marketing ploy by some experts Anthropic has floated the idea of a worldwide “temporary pause” on AI development – and said it was going to convene “policymakers” to discuss the dangers of advanced AI – in its latest release touting the capabilities of its products. In a long post on Thursday, Anthropic detailed the progress of its AI model, Claude, towards “recursive self improvement” – that is, being able to make better and more powerful versions of itself. Recursive self-improvement is a bugbear of AI safety researchers, viewed as the key step for AI to become superintelligent and therefore unleash widespread consequences on humanity. Continue reading...
The next chapter of AI could depend less on breakthrough models and more on the resources required to build and sustain them.
Anthropic's potential IPO highlights the escalating financial demands of AI development, signaling a shift towards public funding for tech innovation. The post Anthropic co-founder says soaring AI costs are pushing the company toward an IPO appeared first on Crypto Briefing.
The artificial intelligence giant said a “brake pedal” was needed to protect humanity from self-improving models. The proposal could have big consequences.
“Why wouldn’t you want to be in both Pepsi and Coke?” says one venture capitalist. “It’s the same here.”
PLUS: Stress test business ideas with Perplexity
What an incredible time it is now for legal AI! Palantir has just entered the legal tech room, joining OpenAI, Anthropic, and Microsoft. So, four ...
