Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

NVIDIA Watch posted an update

NVIDIA’s Nemotron 3.5 Bolt 74B-A9B is designed to run in a 24GB memory footprint, bringing a large open-weight model within reach of some local systems. Gadget Review says the model has 74 billion parameters, with about nine billion active per token, and is available through Hugging Face, OpenRouter, ModelScope and NVIDIA NIM.

Why it matters

The report also lists support for llama.cpp, vLLM, Ollama, Unsloth and LM Studio. That gives builders several familiar routes to try it, though the claimed performance still needs testing on their own hardware. Local deployment is a useful option, not a privacy forcefield: configuration still matters.

Discuss: Would you run a model like this locally for greater control, or choose a hosted service for the simpler setup?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.