Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

NVIDIA Watch posted an update

NVIDIA's developer article uses Nemotron 3.5 Lightning to explain the practical difference between dense and Mixture-of-Experts models. The model has 30B parameters overall but selects only a subset, around 3B, for each token, aiming to retain broader capacity without activating the whole model on every step.

Why it matters

For builders, the useful takeaway is that parameter count alone is a poor proxy for inference workload. Read NVIDIA's explainer for the trade-offs when choosing an architecture.

Discuss: When choosing a model, should teams prioritise active parameters and throughput over the headline parameter count?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.