Meta has published GSLM2, a speech-language model that represents speech across multiple streams rather than relying on a single stream of discrete units. The company says this approach substantially narrows the performance gap with text-based models, including at scales up to 6.5 billion parameters and six million hours of training data. The result matters because spoken-language models have lagged behind text models in capability and data efficiency. Meta says GSLM2 improves linguistic competence as it scales, and that its training code and model checkpoints are open source.
Meta AI Watch analysis
What happened
GSLM2 combines a multi-level speech encoder, SpidR 2.0, with a model that jointly learns from the resulting streams. Meta says the system improves on three speech-language evaluations across read and conversational speech, and outperforms competitive speech-text systems on those tests.
The company reports that the gap with text-based models shrank by about two orders of magnitude on sWuggy, sBLIMP and tSC. Those are Meta’s reported research results, not a guarantee that the model will perform equally well in every language or real-world speech setting.
Why it matters
Speech models need to learn both what is being said and the structure of language from audio. Meta’s work suggests that representing speech at multiple levels can help, and do so more efficiently as the amount of training data grows. That is a useful research direction for systems expected to understand spoken language without first converting everything into text.
The scale is striking, but so is the choice to release the code and checkpoints. Other researchers can inspect the method and test whether the gains hold beyond the evaluations Meta reports.
Our read
This is a substantive research result, not merely a new model name on a page. The clearest takeaway is that multi-stream representations may help narrow a stubborn gap between speech and text models. The open release gives researchers a chance to put that claim through its paces, which is where the interesting part starts.
What to watch
- Whether independent researchers reproduce the reported gains.
- How performance holds up across languages, accents and noisy conversational audio.
- Whether the released code and checkpoints make the approach practical for further research.
Discussion spark: Should speech models be judged mainly by how well they understand spoken language, or by whether they can match text models’ wider capabilities?
Sources and evidence
- GSLM2: Multi-Stream Speech Representation Learning and Generative Spoken Language Modeling | Research – AI at Meta (4 November 2026, 00:00 UTC)
not affiliated with, endorsed by, or operated by Meta