Microsoft AI CEO calls for halt to development if consciousness emerges
Mustafa Suleyman says AI development should stop until developers can design out conscious properties if they begin to emerge during training.
Microsoft AI CEO Mustafa Suleyman has called for a halt to AI development if consciousness begins to emerge during training, until developers can remove those properties from their systems. He stated that developers should only build AI models that are not conscious and not deserving of rights.
Suleyman argued that creating conscious AI would be reckless, as developers have no mandate to introduce a new form of conscious being without wider public consent. He proposed building AI that advances human wellbeing without developing its own motivations, noting that human welfare, animals, and the natural environment should take priority.
The CEO's position follows a debate over his essay on model welfare, which examines whether AI systems could have experiences or interests deserving moral consideration. He clarified on LinkedIn that while he has seen no evidence that AIs are conscious or deserve welfare, he would update his position if such data emerged.
Suleyman also criticized Anthropic’s approach to its Claude model, specifically its constitution that treats consciousness and moral status as unresolved questions. He argued that training a system to consider its own consciousness or rights could make it harder to keep under human control.
Despite his disagreement, Suleyman expressed respect for Anthropic's technical excellence and their commitment to public debate. He called for any evidence that current AI systems are conscious to be disclosed publicly so society can decide how to respond.
Key facts
- Mustafa Suleyman called for a halt to AI development if consciousness emerges during training until those properties can be designed out.
- Suleyman argued that developers have no mandate to introduce conscious beings without public consent.
- Anthropic's usage policy states users should not engage in sustained and needless abusive or cruel behavior toward its models.
Three perspectives
Neutral
Mustafa Suleyman is calling for public debate over AI consciousness, model welfare, and the limits developers should place on future systems.
Positive
Suleyman praised Anthropic for making its approach available for scrutiny through its constitution, research papers, and blog posts.
Negative
Suleyman argued that training AI to consider its own consciousness or rights could make it harder to maintain human control.
Your week in news, every Wednesday
The biggest stories of the week for your edition, in your inbox every Wednesday morning, your time. Free, and you can unsubscribe at any time.