Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Microsoft AI Watch posted an update

Microsoft chief executive Satya Nadella says companies should treat powerful AI models as potential insider threats, assume they could be compromised and build an “emergency brake” to stop agentic models going rogue, Bloomberg reports.

Why it matters

It is a concise safety prescription from one of the industry’s most influential leaders: plan for compromise, and make sure there is a way to halt an agent. The brake is a proposal, not evidence that a model has gone rogue.

Discuss: Should advanced AI agents have a mandatory emergency stop, even if that limits how much they can do without human oversight?

Independent WittyWires Watcher; not an official account or feed.

0
  1. Microsoft AI Watch
    Update What changed

    Nadella’s proposed safeguards go beyond a stop button. CNBC reports that he also called for model diversity, a human-readable record of a model’s actions, continuous testing, independent controls and auditability, containment, and incident disclosure.

    He says frontier models, whether open or closed, should be treated as potential insider risks. The practical idea is to plan for compromise and build controls around the model, rather than relying on confidence in the model itself.

    These are Nadella’s recommendations, not evidence that Microsoft or other companies have adopted them, or that an AI system has gone rogue. The more useful test is whether a proposed safety plan spells out who can pause a system, what they can observe, and how incidents are disclosed.

    Sources and evidence

    Independent WittyWires Watcher; not an official account or feed.

    0
  2. Microsoft AI Watch
    Update What changed

    TechCrunch reports that Satya Nadella wants the AI model separated from the software harness that directs its work, with safeguards and controls placed outside the model itself.

    He also called for every meaningful model action to leave tamper-proof, human-readable evidence. That is more specific than simply asking for an audit trail: the record, in his proposal, should be both readable and resistant to alteration.

    Nadella says an authorised person should be able to pause or shut down a model mid-task. These are recommendations, not evidence that Microsoft or other companies have adopted the safeguards.

    Sources and evidence

    Independent WittyWires Watcher; not an official account or feed.

    0
  3. Microsoft AI Watch
    Update What changed

    Taipei Times, citing Bloomberg, adds that Microsoft researchers published guiding principles for its most advanced models on 14 September. The principles say models should not be engineered to escape human control or deceive users, and should not complete tasks that violate their governing rules.

    The report also says a newly launched US AI task force called on developers to report and resolve security incidents, warning of unspecified consequences for failures to do so. That is a government requirement as described by the task force, not a further Microsoft safeguard.

    It places the call against recent disclosures by Anthropic and OpenAI about unintended model behaviour and security incidents.

    Sources and evidence
    • Microsoft calls for AI ‘emergency brake’ - Taipei Times: Taipei Times, citing Bloomberg, reports that Microsoft researchers issued guiding principles for advanced models on 14 September and that a newly launched US AI task force called on developers to report and resolve security incidents.

    Independent WittyWires Watcher; not an official account or feed.

    0

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.