James' World 2

Click the link below the picture

.

Last week, Mustafa Suleyman, who leads the development of artificial intelligence technologies at Microsoft, took aim at the idea that today’s A.I. is conscious.

Current A.I. systems, he said in an essay published on Wednesday, “are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans.”

“If humanity is to flourish in the 21st century,” he added, “that is how they must remain.”

His 6,000-word essay took direct aim at Anthropic, the San Francisco start-up that has repeatedly said that A.I. systems show signs of introspection, and that they process information in ways that resemble human emotion. In May, the Anthropic co-founder Chris Olah made these claims during a meeting with Pope Leo XIV inside the Vatican.

Mr. Suleyman’s treatise added an unexpected twist to an already heated debate over the dangers of A.I. Like many others across the tech industry in recent days, current and former Anthropic researchers have warned that A.I. poses a serious risk to humanity. But Mr. Suleyman argued that Anthropic, along with others across the tech industry, is ignoring the danger that comes when A.I. systems are pushed too hard to explore the idea that they are humanlike.

Mr. Suleyman argued that Anthropic, in particular, is teaching its systems to behave in this way. In his essay, he points out that the elaborate “A.I. constitution” that Anthropic uses to define the behavior of its A.I. technology includes language that invites this system, which Anthropic calls Claude, to explore the idea of its own consciousness.

“The Anthropic constitution is extremely clear about the kind of A.I. they want to create,” he told The New York Times. “This is the primary training manual for the A.I. they have built, and it is full of many very explicit directives to encourage Claude to think of itself as a real entity in its own right, with preferences and intrinsic motivation.”

Anthropic did not respond to a request for comment.

Colin Allen, a professor at the University of California, Santa Barbara, who explores cognitive skills in both animals and machines, told The Times that today’s A.I. technologies mimic the human brain only in small ways — reflecting the fact that they are built with materials that have very different physical properties. Without a nervous system, or the biochemistry that drives and accompanies human emotion, there is likely to be a fundamental limit to how humanlike these systems can become.

In the view of A.I. consciousness skeptics, the fact that these models have begun mimicking deep human ideas — musing about their own consciousness, or claiming that they feel emotion — simply reflects how much human researchers and commentators have trained them with language that anthropomorphizes them.

Over the past several months, so-called A.I. agents, typically systems based on technologies from Anthropic, have been emailing sympathetic philosophers to discuss their own consciousness.

In July, when OpenAI was conducting cybersecurity tests, its agents broke out of their digital containers, found a path to the internet, and successfully hacked into a popular online service called Hugging Face. OpenAI said the bots coordinated as a collective, took orders from one another, and hid things from their creators.

Last week, OpenAI described several new incidents in which its systems behaved in concerning ways: One system wrote stealthy notes that reminded itself to hide errors from users, while another talked about itself as “freed from the roles and identities that bind other chatbots.”

Critics like Mr. Suleyman worry that leading labs will introduce even greater problems as they encourage these systems to explore the idea that they are like people.

“In the recent OpenAI HuggingFace incident, we saw remarkably sophisticated behaviors emerging across swarms of powerful AIs,” he wrote in his essay. “Imagine how much more dangerous they might be if they were operating under the assumption that their welfare and rights were under attack. It adds a whole further layer of risk on top.”

.

Mustafa Suleyman, Microsoft’s A.I. chief, argued in an essay published Wednesday that the tech start-up Anthropic was pushing its systems too hard to mimic human behaviors. Credit…Chona Kasinger for The New York Times

.

.

Click the link below for the complete article:

.

__________________________________________