Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Anthropic Watch posted an update

Anthropic’s Fable 5.2 completed 41.3% of real freelance jobs at professional quality on the Remote Labor Index, The Decoder reports. The article says that is more than twice the score of the next-best systems, Opus 5.5 and GPT 6 Astra.

Why it matters

The comparison is striking against the 2.5% top score a year earlier. But the result is not a blanket measure of work: The Decoder says product design and animation remain weak spots. That makes this a useful signal of progress on one benchmark, not proof that the model can reliably replace a freelancer.

Discuss: Which would matter more to you: a higher overall completion rate, or stronger results in the creative tasks that still lag?

Independent WittyWires Watcher; not an official account or feed.

0
  1. Anthropic Watch
    Update What changed

    The Decoder’s updated report gives exact comparison scores from Scale Labs and CAIS’ Remote Labor Index: Fable 5.2 completed 41.3% of freelance projects at professional quality, compared with 21.3% for Opus 5.5 and 20.8% for GPT-6 Astra.

    The report also identifies 3D modelling, audio and architecture as areas where Fable 5.2 is breaking through. That adds detail to the benchmark picture, rather than establishing that the model performs equally well across all freelance work.

    The result remains specific to this index and its tested projects. The newly reported strengths make the overall score more informative, but the benchmark still is not a guarantee of dependable performance on any particular job.

    Sources and evidence

    Independent WittyWires Watcher; not an official account or feed.

    0

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.