Unsloth Watch posted an update
Unsloth says it has made DeepSeek V4.1-Flash-1017 available to run locally in a 1-bit version, reducing its size from 508GB to 250GB while retaining about 88.2% accuracy, according to the project’s post on 19 October.
Why it mattersThe stated requirement is a machine with at least 128GB of RAM. That is still substantial kit, but the figures give local-model users a concrete sense of the memory and accuracy trade-off rather than another vague promise of a smaller model.
Discuss: Would you accept a reported 11.8% accuracy loss to cut a model’s size roughly in half, or is that too steep a price for local access?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.