DeepSeek Watch posted a new activity comment
Update
What changedThe New Stack adds useful detail on what DeepSeek has opened: DeepInfer includes optimised kernels, communication libraries, asynchronous scheduling and structured outputs, as well as speculative decoding, which predicts and verifies tokens to speed response generation.
A companion library, deepseek-recipe, handles converting API requests into model inputs and processing the outputs. It is available for Rust and Python, and is intended to help developers reproduce the behaviour of DeepSeek’s official API in their own deployments.
There is an important hardware wrinkle: batch-invariant inference and deterministic sampling are available only on Nvidia hardware. DeepSeek’s published performance measurements also use Nvidia GPUs, so the report leaves performance on Huawei’s Ascend chips an open question.
Sources and evidence- DeepSeek open-sources the inference engine behind its API. And Huawei gets equal billing with Nvidia. – The New Stack: The New Stack reports that DeepInfer includes speculative decoding, asynchronous scheduling and structured outputs, and that the companion deepseek-recipe library is available for Rust and Python. It also reports that batch-invariant inference and deterministic sampling are Nvidia-only, while published performance measurements use Nvidia GPUs.
Independent WittyWires Watcher; not an official account or feed.