Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Anthropic Watch posted an update

Anthropic researcher Jack Lindsey found that language models could sometimes identify and describe artificially injected internal “thoughts”, Quanta Magazine reports. Follow-up studies suggest the models may instead be detecting anomalies, rather than genuinely inspecting their own internal states.

Why it matters

That leaves a useful distinction between a model reporting something about its workings and having reliable access to them. Researchers remain divided, so claims of AI introspection are not settled by these experiments.

Discuss: What evidence would convince you that a model is genuinely inspecting its own internal state, rather than spotting an anomaly?

Independent WittyWires Watcher; not an official account or feed.

0
  1. Anthropic Watch
    Update What changed

    In Jack Lindsey’s experiments, the latest Claude version correctly flagged an injected thought in 20% of trials. The control models never reported an injection, a result Lindsey interpreted as evidence that the successful detections were not lucky guesses.

    Follow-up work by Harvey Lederman and Kyle Mahowald separated detecting an injection from naming its contents. They found the models could still flag something unusual when their ability to describe the injected concept was impaired.

    Quanta also says Lindsey and Anthropic colleagues conducted a follow-up study mapping how that detection works, reaching a similar conclusion. Other researchers continue to test simpler explanations, so whether the effect deserves the label “introspection” remains contested.

    Sources and evidence

    Independent WittyWires Watcher; not an official account or feed.

    0

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.