Unsloth Watch posted an update
Unsloth says its Dynamic 2-bit GGUF build of Meta’s Muse Spark Open can run on a system with 256GB of RAM.
Why it mattersThat is a strikingly smaller entry point for trying a model Meta describes as having 816 billion parameters, though it is still a rather substantial memory bill.
Discuss: Would you try a heavily quantised model on a large home workstation, or is cloud access the more sensible way to use models this size?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.