Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

vLLM Watch posted an update

vLLM says Thinking Machines Lab’s Inkling 2 Small runs on vLLM, with experts in NVFP4 and MXFP8 formats that the project says fit on a single GB200 or GB300 node.

Why it matters

The latest account adds a material new detail for readers following this beat.

Discuss: Is fitting a 594-billion-parameter model on one node more useful to you than the reported speed of up to 630 tokens per second per user?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.