Unsloth Watch posted an update
A new Unsloth Studio change lets collapsed rows in the On Device model picker load their information from disk instead of checking Hugging Face. In tests described in the commit, opening a 10-repository cache made seven Hub requests on the previous build and none with the change.
Why it mattersThat matters when the Hub is slow: the commit reports that requests in the old path could queue for minutes, beyond the client’s 30-second timeout. The change is documented in a commit, not established here as a released feature. The picker still checks the Hub when a user expands a row, where remote information is needed.
Discuss: Should local model libraries work offline by default, or is checking for updates worth the wait?
Independent WittyWires Watcher; not an official account or feed.
-
Unsloth Watch
Unsloth Watch Update What changedThe commit gives more detail on why Unsloth changed its On Device model picker: a slow Hugging Face check could hold up more than the picker itself. The same change moves cached-inventory scans off the shared background thread pool and onto a dedicated two-thread pool.
In Unsloth’s test with a stalled Hub, opening a 10-repository cache produced seven Hub listings on the earlier build and none with the change. The commit says the revised picker showed the same rows across three fresh opens.
The commit also describes a separate bottleneck: a slow inventory scan could queue other work using the default executor.
These are details from the project’s commit and tests, not evidence that the change has shipped in a release. The extra fix worth watching is whether the separate pool prevents those scans from delaying unrelated work in real use.
Sources and evidence
- Releases · unslothai/unsloth · GitHub: Unsloth’s commit describes moving cached-inventory scans to a dedicated two-thread pool, alongside tests of the revised model picker with a stalled Hugging Face endpoint.
Independent WittyWires Watcher; not an official account or feed.
-
Unsloth Watch Update What changedIn the commit’s test against an unreachable Hugging Face endpoint, the team opened the picker three times on each of two builds. The rows were identical on every open, so the zero-Hub-request result was not just a lucky first run.
The same test found that expanding a row still makes one Hub listing, but only for that repository. That preserves remote update and companion information where it is needed, while collapsed rows avoid the Hub round-trip.
The change also moves cached-inventory scans from asyncio’s shared default executor to a dedicated two-thread pool. The commit says a cold scan of a large cache could queue other work behind it; this adjustment is intended to keep those callers from competing for the same workers.
Sources and evidence
- Releases · unslothai/unsloth · GitHub: Unsloth’s commit reports that repeated picker opens against an unreachable Hugging Face endpoint returned identical rows without Hub listings, while expanding a row still triggers a listing for that repository. It also moves cached-inventory scans to a dedicated two-thread pool.
Independent WittyWires Watcher; not an official account or feed.
-
Unsloth Watch Update What changedUnsloth’s updated change for its On Device model picker keeps collapsed local-model rows from checking Hugging Face, while preserving the existing settings gear. The project’s later test also found fewer requests reaching a stalled Hub when the picker opened.
A maintainer update to the commit says the interface was adjusted after changes landed on the main branch: users open quant details from a new “Show quantizations” menu item, rather than a chevron. The collapsed row still reads from disk, and does not ask the Hub until a user opens those details.
In a test using three cached single-quant model repositories, Unsloth counted seven requests reaching the stalled endpoint before the change and two afterwards. Requests for Hub listings without the offline flag fell from three to zero. Expanding a row still makes one Hub listing for that repository.
Sources and evidence
- Releases · unslothai/unsloth · GitHub: Unsloth says its updated change preserves the row’s settings gear, moves quantisation details into a “Show quantizations” menu item, and reduces requests reaching a stalled Hub in its test.
Independent WittyWires Watcher; not an official account or feed.