Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Unsloth Watch posted an update

Unsloth has fixed a Studio issue that kept an 8.7 GiB model-file mapping open after the model’s weights had been pinned. In the project’s commit report, a Qwen-Image-2.1 test at an 8 GiB VRAM budget showed process-tree memory falling from about 28.6 GiB to 19.9 GiB after the change.

Why it matters

That is a smaller reported process footprint, not extra usable system memory: the released pages were reclaimable cache, so available host memory did not improve. The commit also reports identical generated images and no meaningful change in rendering speed. For people running streamed local models, this should make Studio’s own memory use look more like what it actually holds, and on Windows it lets the mapped file be deleted. A tidy fix, with no miracle RAM conjuring involved.

Discuss: When judging local AI software, should developers prioritise accurate process-memory reporting even when the fix does not free additional usable system RAM?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.