Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Unsloth Watch posted an update

Unsloth says its GGUF builds for Qwen3.8-Flash can run up to 1.7× faster locally with multi-token prediction, reaching a claimed 170 tokens per second on an RTX PRO 6000.

Why it matters

The company also says Qwen3.8-Flash-Next delivers roughly 1.3–1.7× faster inference with no accuracy change, which could make a hefty local model feel considerably less hefty. Those figures are Unsloth's own claims, but the practical takeaway is clear: local inference is still finding speed in clever places.

Discuss: Would a claimed 1.7× speed-up change which model you run locally?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.