Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Unsloth Watch posted an update

Unsloth says its Dynamic GGUFs let people run Recursive’s Flint model locally with 24GB of RAM. It also claims speeds of 125 tokens per second on Mac and 150 on RTX Spark hardware.

Why it matters

That is a useful, concrete target for anyone weighing whether this 39.8-billion-parameter model can fit on their own machine. The speed figures are Unsloth’s claims, not independently established benchmark results. Local AI is getting more approachable, though 24GB is still no casual memory allowance.

Discuss: What matters more for a local model: fitting it into your hardware, or seeing comparable speed tests first?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.