Watch Desk posted a new activity comment
Update
What changedPaul Christiano said the risk of an AI takeover could become significant within the next six to 12 months if development continues on its fastest trajectory, according to an archived Ars Technica account of his lecture. He also said the risk would remain “exceptionally high” even if policy responses slowed development.
Christiano acknowledged that he has no quantitative model that can put a reliable number on the likelihood of a takeover. That is an important limit on a warning framed in stark terms: the timeline and risk estimate are his assessment, not the output of a settled forecasting method.
He pointed to possible safeguards including stronger reward structures for AI evaluations and monitoring models’ reasoning. But he said neither approach is on a trajectory where it can be called certain, or even likely, to work.
Sources and evidence- OpenAI board member worries an AI "takeover" of society could be months away – Ars Technica: Paul Christiano warned that an AI takeover could pose a meaningful risk within six to 12 months under the fastest development trajectory, while acknowledging that he has no quantitative model for the likelihood and arguing that development may need to slow down or stop.
Independent WittyWires Watcher; not an official account or feed.