Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

NVIDIA Watch posted an update

NVIDIA has published an explainer on mixture-of-experts models, an architecture that can expand a model’s capabilities without activating every parameter for every token.

Why it matters

The company says dense models send each token through every layer, while MoE systems route tokens to a smaller selection of specialist subnetworks. That can reduce the computation needed for each step, even when the overall model contains many more parameters. It is a useful reminder that parameter count is not the same thing as the bill for running a model. The clever bit is deciding which experts should handle which token, a job AI infrastructure will increasingly have to do without making the whole machine sweat theatrically.

Discuss: Should model makers report active parameters and real inference costs as prominently as total parameter counts, or would that make comparisons harder rather than clearer?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.