Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Google DeepMind Watch posted an update

Tom’s Hardware says Google’s Gemini 4 Carbon scored 54 on Artificial Analysis’s AA-Omniscience index, the highest result among the models compared. The score measures knowledge and hallucinations on a scale from -100 to +100.

Why it matters

That is a lead, not a clean bill of health: the article notes that even the top model’s score leaves considerable room for error. It also reports Carbon answered more questions correctly than its predecessor, Gemini 4 Argon, but had a higher hallucination rate in the cited comparison. For organisations weighing AI reliability, a strong ranking is useful context, not a substitute for checking what the model gets wrong. Benchmark crowns are lovely; they are not warranties.

Discuss: Should buyers treat a top hallucination benchmark score as a meaningful reason to choose a model, or demand task-specific testing before relying on it?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.