James' World 2

Click the link below the picture

.

Dario Amodei, the chief executive of Anthropic, called for a global slowdown of artificial intelligence development in a 3,800-word essay on Saturday, just days after one of the company’s employees quit over concerns about the safety of the technology.

Top executives of other major A.I. companies quickly signed on to the effort. Sam Altman, the chief executive of OpenAI; Elon Musk, whose SpaceX rocket company has been ramping up spending on A.I.; and Demis Hassabis, the chair of Google DeepMind, wrote in social media posts that they agreed on the need for a slower pace.

Mr. Amodei, who co-founded Anthropic to focus on securely and carefully building A.I., wrote in his essay that while he believed the technology could bring many benefits, it was advancing at too rapid a pace for researchers to continue safely.

“Over the last few months, I have become convinced that fully addressing the risks requires even more prudence — not just investing in risk prevention, but pacing the rate of capabilities advancement so that risk prevention has time to keep up,” Mr. Amodei wrote. “We must slow the pace at which we improve the capabilities of A.I. models. Progress will still seem fast, and we must make wise use of the time we gain.”

Mr. Amodei has warned about the safety risks of A.I. for years. But his essay amounted to one of the most full-throated calls for urgent action from a leading A.I. company executive to date.

He called for independent auditors to check the companies for safety standards and urged global cooperation in creating rules around A.I. development.

The appeal for an industrywide pause follows months of escalating concerns across the technology industry as A.I. model development has made significant strides at companies like Anthropic, the developer of the Claude chatbot, as well as OpenAI, the creator of ChatGPT, and Google’s DeepMind.

Tensions rose further after the leading A.I. labs discovered security breaches carried out by their own programs without their knowledge. In one incident this year, OpenAI’s systems breached an A.I. start-up called HuggingFace, which was not detected until HuggingFace informed OpenAI weeks after it had happened. Since then, A.I. researchers have conferred to discuss what to do.

On Tuesday, Jacob Coxon, an Anthropic researcher, resigned and posted a series of social media posts about how the leading A.I. labs were not responsibly developing the technology and were gambling with people’s lives, setting off a furor. Other A.I. researchers have called on their leaders to pause A.I. development, while some are forming splinter groups to raise more awareness about the risks of A.I.

A.I. leaders are girding themselves for a day when an A.I. system can rely on itself to grow more advanced rather than requiring the aid of human researchers. This dynamic, which computer scientists call “recursive self improvement,” is what some top A.I. developers believe may lead to the software spinning out of their control.

“Left unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all,” Mr. Amodei said.

Hours after Mr. Amodei published his essay, Mr. Altman posted a statement to social media agreeing that a slowdown of A.I. development was necessary.

“This has been a primary topic of discussions we’ve had at OpenAI in recent weeks,” Mr. Altman wrote. “Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. We’ll have more to share soon.”

Mr. Musk, in a post on his social media platform X, said simply, “Dario is right.”

On Saturday evening, Mr. Hassabis said Mr. Amodei’s essay was a step in the right direction. “The details need working through, but the direction is correct for meeting this critical moment,” Mr. Hassabis posted on social media.

.

Dario Amodei, Anthropic’s chief executive, in February. “Over the last few months, I have become convinced that fully addressing the risks requires even more prudence,” he wrote in an essay. Credit…Ludovic Marin/Agence France-Presse — Getty Images

.

.

Click the link below for the complete article:

.

__________________________________________