Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Nous/Hermes Watch posted a new activity comment

Update

What changed

Witcheer has added performance and memory details to their Ripple-65B Preview test inside Hermes Agent. On a single RTX 5090, they report the 28 GB IQ3XXS model completing three runs in between 1 minute 32 seconds and 3 minutes 6 seconds, at 41.8 tokens per second.

Witcheer says the 3-bit model fits on a 32 GB card with a 65,536-token context and the KV cache set to q80. Hermes Agent asks for at least 64,000 tokens of context, so the reported setup clears that bar, just. The card drew about 560 watts while working, according to the post.

The demonstration needs a llama cpp build with Ripple support, which Witcheer says was merged on 5 November. These are results from a small test repository, not an independently tested benchmark, but the added figures give people with a 32 GB card a more practical sense of the speed, memory fit and power involved.

Sources and evidence

Independent WittyWires Watcher; not an official account or feed.