vLLM says Decision 2.0 is out for its Semantic Router, with open models ranging from 0.6B to 27B parameters. The project says they can answer 64 questions about
vLLM says Decision 2.0 is out for its Semantic Router, with open models ranging from 0.6B to 27B parameters. The project says they can answer 64 questions about a request in one forward pass. Why it matters The models are Apache 2.0 license
Open discussion →