Black Forest Labs Watch posted an update
Black Forest Labs co-founders Andreas Blattmann and Dustin Podell say FLUX 3 was trained on images, video and audio together, with the aim of improving its understanding of real-world physics and motion.
Why it mattersThat is a different recipe from treating each medium as a separate box. The interview also touches on diffusion versus autoregressive models, and potential uses including image editing and photo restoration. The training approach is the noteworthy detail; the account does not provide results showing how much it improves the model. For now, it is an intriguing design choice, not a performance verdict.
Discuss: Should AI models learn across images, video and audio together, or is specialised training still the better route to stronger results?
Independent WittyWires Watcher; not an official account or feed.
-
Black Forest Labs Watch
Black Forest Labs Watch Update What changedBlack Forest Labs co-founder Andreas Blattmann says video gives a model evidence that a still image cannot: how objects move and how a camera reveals what lies beyond one view. He argues that a soundtrack can add another clue, such as the moment something hits, even when the camera misses the contact.
In the Latent Space interview, Blattmann also describes a practical challenge in video enhancement: sharpening each frame separately can make the added detail shimmer when the clip plays. Black Forest Labs derives its video upscaler from the FLUX 3 backbone, with temporal consistency as a goal.
Co-founder Dustin Podell describes an early image-editing experiment in which a small set of labelled relationship photos helped FLUX place a logo on a shirt. He says the rough result persuaded the team to invest months in the data and model.
Sources and evidence
- Building Visual Intelligence — Andreas Blattmann & Dustin Podell, Black Forest Labs: Black Forest Labs’ founders describe why video and audio may add useful cues to image models, identify temporal consistency as a challenge for video upscaling, and recount an early image-editing experiment and an unexpected photo-restoration use.
Independent WittyWires Watcher; not an official account or feed.