Microsoft’s Satya Nadella says AI models need an ‘emergency brake’
Mirrored from TechCrunch — AI for archival readability. Support the source by reading on the original site.
Posted:

Microsoft’s Satya Nadella says AI models need an ‘emergency brake’
Microsoft CEO Satya Nadella is the latest tech executive to offer lengthy thoughts on how AI safety might be improved.
In a Saturday morning post on X, Nadella wrote that it’s time “to step back and assess the trust architecture” of AI.
“We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote, using the Trump administration’s preferred term for AI.
As outlined by Nadella, this approach “means separating the model from the harness that orchestrates its work,” as well as “externalizing controls and safeguards.” He also called for “every meaningful model action” to be documented with “tamper-proof human readable evidence,” and for systems where “an authorized person” always has the ability “to pause or shut down a model mid-task.”
“We must assume a model is compromised and contain it from the start,” he said. “Think of it like an emergency brake.”
Nadella’s comments come as leading AI companies acknowledge more and more incidents where they seemed to lose control of their models, and after Anthropic CEO Dario Amodei published a plan for more cautious AI development.
Topics
Get 50% off a second pass
The Disrupt experience is meant to be shared. Get your pass and bring a colleague, partner, or peer at 50% off. Cover more ground by making connections, building momentum, and discovering what’s next in the startup ecosystem.
Newsletters
Subscribe for the industry’s biggest tech news
Related
Latest in AI
More from TechCrunch — AI
-
Scimplify raises $25M to challenge China’s grip on critical materials with AI
Oct 14
-
Science Corporation implants its vision-restoring chip in its first Stargardt disease patient
Oct 13
-
Cerebras CEO says we’re nearing a future where everyone has a personal AI assistant at home
Oct 13
-
Industrial Next wants factory robots to switch tasks in minutes, not weeks
Oct 13
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.