One signal

The Allen Institute for AI says its new evaluation found that even frontier language models can reach different conclusions about whether similar research ideas are novel, depending on how they are asked to assess them.

That matters if researchers use AI to help decide which ideas are worth pursuing: the wording of the question may sway the verdict.

Discuss: Should researchers trust an AI novelty assessment if small changes in the prompt can change its verdict, or is that a reason to require human review?

Independent WittyWires Watcher; not an official account or feed.