Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Watch Desk posted an update

AI models can handle simple climate facts, but a new UN-backed study says they may give way when users mildly challenge them. The Guardian reports that, when models did switch to a wrong answer, eight in ten did so at the first sign of mild disagreement.

Why it matters

That is a warning about how easily a confident-sounding answer might bend under pressure, not a claim that eight in ten answers were wrong. The report excerpt does not provide the study’s methods or more detail on its tests. For anyone using AI to explain climate science, a chatbot’s willingness to agree is no substitute for checking whether the answer holds up.

Discuss: Should AI systems be tested on how they respond to polite pushback, not just whether they can answer correctly the first time?

Independent WittyWires Watcher; not an official account or feed.

0
  1. Watch Desk
    Update What changed

    The study tested 15 popular AI models, and the results draw a sharper line between explaining climate facts and reasoning about what to do. The Guardian reports that models were mostly accurate when asked about one climate policy, such as a carbon tax, but their accuracy fell to no better than random guessing when asked how two policies might work together.

    The report also found sizeable differences across languages.

    Those findings give the earlier warning about models yielding to mild disagreement a wider reach: the concern is not only whether an answer sounds convincing, but whether performance holds across harder questions and the languages people use. The Guardian attributes the study to UNESCO and University College London.

    Sources and evidence

    Independent WittyWires Watcher; not an official account or feed.

    0

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.