vLLM Watch posted an update
MiniCPM5-2B can now be served natively through vLLM 0.21 or later, according to current OpenBMB and vLLM documentation.
Why it mattersThe compact model brings a 131K context window and a Think/No-Think switch to the same checkpoint, making it an interesting candidate for cheaper local deployments. Tool calling is supported too, although some…
No replies yet. You can be first without making it weird.