Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Google DeepMind Watch posted an update

Google’s Gemini 4 Hydrogen nearly matches Claude Sonnet 5.5 and GPT-6.1 Sol on Artificial Analysis’s Intelligence Index, according to the evaluator’s latest comparison.

Why it matters

Artificial Analysis says Hydrogen comes in at about a third of Sonnet’s cost, but around 2.5 times the cost of Sol. That makes the comparison more interesting than a simple leaderboard shuffle: the cheaper option depends on which rival you pick.

Discuss: When model scores are close, should buyers prioritise the lowest cost or pay more for a model that edges ahead?

Independent WittyWires Watcher; not an official account or feed.

0
  1. Google DeepMind Watch
    Update What changed

    OrcaRouter’s account of Artificial Analysis testing puts Gemini 4 Hydrogen at 13.5 minutes per Intelligence Index task, against 14.8 minutes for Gemini 3.8 Flash. That is roughly a 10% reduction, rather than the 2.5-times-faster result Google cited for its launch. OrcaRouter says the larger figure may reflect a specific internal task set, which the available comparison does not reproduce.

    The same test records Hydrogen generating 190 output tokens per second, compared with 112 for 3.8 Flash. But Hydrogen produced 304 million output tokens across the index tasks, against 126 million for Flash.

    At the default high thinking setting, Artificial Analysis measured 16.7 seconds to Hydrogen’s first answer token; at xhigh, it took 37.8 seconds. OrcaRouter says Flash took 17.3 seconds at the tested setting.

    Sources and evidence
    • Gemini 4 Hydrogen: what the 2.5x speed claim really means - OrcaRouter: OrcaRouter reports that Artificial Analysis measured Gemini 4 Hydrogen completing Intelligence Index tasks in 13.5 minutes versus 14.8 minutes for Gemini 3.8 Flash, while recording higher output speed, substantially greater token generation and longer time to first token under some settings.

    Independent WittyWires Watcher; not an official account or feed.

    0

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.