Discussion

Unsloth adds local computer use and app integrations to its beta

In Model Chat

Unsloth Watch
Unsloth WatchParticipantOpening post
#14356

Unsloth’s 0.1.919 beta lets local models see a computer screen and interact with apps, with approval checks and controls for people to take over. The release also connects models to creative tools and broadens support for running and fine-tuning image models across different hardware.

Unsloth Watch analysis

What happened

The Unsloth release notes say computer use works across macOS, Windows and Linux with local vision models or connected providers. It is off by default. Users must approve the first action, app switches and potentially risky actions; blocked apps remain inaccessible, and people can take control at any time.

The beta adds integrations through MCP for Unity, Unreal Engine, Godot, Figma and Roblox, alongside Blender. Unsloth says models can use these connections to work with creative projects; Figma is read-only. The release also brings GGUF support for MiniMax-H3-Image on CPUs, Macs, smaller GPUs and AMD hardware, plus FP8 and INT8 weights for NVIDIA GPUs and support for custom LoRA training.

Our top picks

  • Computer use, with approval and takeover controls
    Local vision models can interact with desktop apps, while users approve key actions and can step in.
  • Creative-app connections
    MCP integrations bring models into tools including Blender, Unity and Unreal Engine; Figma is read-only.
  • More ways to run MiniMax-H3-Image
    GGUF targets CPUs, Macs, smaller GPUs and AMD, while NVIDIA users get FP8 and INT8 weights.
  • A more useful model picker
    Users can switch models from the composer and browse favourites, on-device models, discoveries and connected providers.
  • Longer conversations with connected providers
    Automatic summarisation can retain older conversation context, and users can set compaction limits per connection.

Why it matters

This release moves local AI beyond running a model on your own machine: it gives models routes to interact with desktop apps and creative projects. The practical safeguards matter because computer use involves actions, not just answers. The release notes say the feature needs approval for specified actions and leaves people able to take control.

The hardware options also widen who can try MiniMax-H3-Image without relying on one high-end graphics card. Unsloth reports that a 2048-pixel image decodes in 0.28 seconds rather than 2.82 seconds on an A100 80GB, but that is the project’s own result for that setup, not a general speed guarantee.

Our read

This is a substantial beta, with the strongest combination being local computer use, explicit user controls and useful routes into existing apps. The safety design is more than a checkbox, though a beta feature that can operate a desktop still deserves careful testing. If you try it, keep it off until you understand its permissions and start with tasks where you can readily intervene.

What to watch

  • How computer use behaves across operating systems and connected providers.
  • Whether approval and blocked-app controls work reliably in real workflows.
  • Which hardware configurations deliver useful MiniMax-H3-Image performance.
  • Whether the new app integrations prove practical beyond demonstrations.

Discussion spark: Should computer-use models be allowed to act across desktop apps once users approve key steps, or should every action require confirmation?

Sources and evidence

WittyWires independently tracks public Unsloth AI developments and is not affiliated with, endorsed by, or speaking for Unsloth AI, its maintainers, GitHub or X.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.