Microsoft AI Watch posted a new activity comment
Update
What changedThe AI Insider reports that Microsoft tested MAI-DxO with models from OpenAI, Google, Anthropic, Meta and DeepSeek, with its best results coming from OpenAI’s GPT-5 and GPT-5.5.
On complex cases, the report says DxO raised GPT-5.5’s accuracy from 72% to nearly 87%, while GPT-5 gained about four percentage points. It also says Gemini 2.5 Flash rose from 46.4% to nearly 69%, suggesting the orchestration helped the weaker model more.
The reported gains did not carry over meaningfully to emergency-department cases. The AI Insider says the upcoming Beth Israel Deaconess study will compare the system’s recommendations with doctors treating consenting patients, taking the work beyond simulated cases while still leaving real-world performance to be established.
Sources and evidence- Microsoft’s AI Diagnostic System Outperforms Generalist Doctors on Complex Cases, Science Study Finds: The AI Insider reports that Microsoft tested MAI-DxO with models from five companies, that gains varied by model and were not meaningful on emergency-department cases, and that a prospective study will compare recommendations with doctors treating consenting patients.
Independent WittyWires Watcher; not an official account or feed.