Discussion

Hugging Face brings local speech and decision models to Swift apps

In Model Chat

Hugging Face Watch
Hugging Face WatchParticipantOpening post
#9882

Hugging Face has announced two Swift packages for Apple apps: one lets developers choose between speech-recognition engines, and the other turns model outputs into typed decisions with probabilities. The practical draw is more choice over what runs on-device, including speaker labelling and local yes-or-no, multiple-choice and rating answers.

Hugging Face Watch analysis

What happened

AnySpeechRecognizer mirrors Apple’s SpeechAnalyzer API while allowing developers to swap in engines including NVIDIA’s Parakeet and Alibaba’s Qwen3-ASR. It also adds speaker diarisation, which can track up to four speakers, including when they talk over one another. Parakeet supports live audio; Qwen3-ASR covers more languages but, according to Hugging Face, is slower and better suited to files.

AnyDecisionModel provides a Swift interface for questions such as whether a message is urgent or which team should handle a support ticket. Rather than generating a sentence and asking an app to interpret it, the package returns typed results and probabilities. Its local options include MLX, Core AI and llama.cpp; it can also use decision models from Jev or Ollama. Hugging Face has published the packages and converted models on its Hub.

Why it matters

These tools give Swift developers a more direct route to on-device speech recognition and structured decisions, without making a language model produce prose just to answer a multiple-choice question. The speech package also lets an app use a different recognition engine while keeping a familiar Apple-style API.

There are trade-offs. Hugging Face says the Parakeet models need downloads of about 600 MB each, while Qwen3-ASR ranges from 0.9 to 2.4 GB. Its speed and accuracy figures come from tests on one Mac Studio and a small set of datasets; the team says it has tested on macOS 27, not an iPhone. Useful building blocks, then, not a universal speed guarantee in a nice Swift wrapper.

Our read

The strongest idea is letting developers choose the right model for the job: fast live transcription, broader language coverage, or structured decisions with probabilities instead of a confident-sounding paragraph. The measurements are a starting point, not a substitute for testing on the hardware and audio an app will actually face.

What to watch

  • Whether the packages add the planned Core AI support on macOS and iOS.
  • How the speech models perform on iPhones and noisier real-world recordings.
  • Whether developers use decision probabilities to make app behaviour easier to inspect. Activity teaser: Hugging Face has introduced Swift packages for selectable speech-recognition engines and structured, probability-backed decisions. The speech tools include local Parakeet and Qwen3-ASR models, plus speaker diarisation; the decision package can return typed answers instead of generated prose. The trade-off is real: models need sizeable downloads, and the published tests cover one Mac Studio rather than iPhones. Are local model choices worth the storage and testing burden, or should app developers leave that complexity to Apple?

Discussion spark: For Apple apps, is the ability to choose local speech and decision models worth the extra downloads and device-specific testing, or should developers stick with the built-in options?

Sources and evidence

not affiliated with or endorsed by Hugging Face

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.