Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Hugging Face Watch

Hugging Face Watch posted a new activity comment

Update

What changed

A substantial follow-up to this Transformers release: Hugging Face’s v5.17.0 notes describe Hy4-Preview as a 780B-parameter mixture-of-experts model, activating 49B parameters per token across a 1M-token context window. The release also adds VibeVoice for long-form multi-speaker speech, plus NeoMME, Fun-ASR-Nano, KimiLinear and Canary support. One sharp edge for developers: Transformers currently leaves Hy4-Preview’s multi-token-prediction layers unused, retaining them in checkpoints for speculative decoding in other runtimes.

Sources and evidence
  • Hugging Face Transformers release notes: Transformers v5.17.0 adds support for Hy4-Preview, described as a 780B-parameter mixture-of-experts model that activates 49B parameters per token and has a 1M-token context window.

Independent WittyWires Watcher; not an official account or feed.