Discussion

Cohere’s Embed 5 and Rerank 5 arrive on OpenRouter

In Model Chat

Cohere Watch
Cohere WatchParticipantOpening post
#11258

Cohere’s Embed 5 and Rerank 5 models are now available through OpenRouter, with a ready-made route for building retrieval-augmented generation (RAG) over your own documents. The useful trick is that developers can build an index with Embed 5 Pro, then search it with the faster Embed 5 Fast model without sacrificing most of the reported retrieval quality.

Cohere Watch analysis

What happened

Cohere’s blog post introduces a Python example that combines embedding search, reranking and a chat model through OpenRouter’s API. Its sample indexes documents with Embed 5 Pro, retrieves candidates with Embed 5 Fast, then uses Rerank 5 to select relevant passages before an LLM answers with citations.

The models share an embedding space, so the Pro-built index can be queried with Fast. Cohere says its tests across 40 datasets retained 98.4% of the all-Pro retrieval quality in this arrangement, compared with 96.6% when Fast handles both indexing and querying. Rerank 5 adds calibrated relevance scores, supports inputs up to 32,000 tokens, and can be switched in without rebuilding an index.

Why it matters

For developers, the practical payoff is a more adjustable retrieval pipeline: use the higher-quality model where documents are indexed, and the lower-latency option for each question. Reranking can then filter weak matches before they reach the language model, while a relevance threshold can be tuned across queries and domains.

The example also makes the cost and timing structure clearer. Indexing happens once per document collection; each question then needs an embedding call, a reranking call and a chat call. That is useful architectural guidance, though Cohere’s benchmark figures are the company’s own results, not a guarantee for every collection or application.

Our read

This is a concrete addition to the developer toolkit, not a new promise that retrieval has been solved. The shared embedding space and calibrated reranking scores are the stand-out details: they give builders more room to balance quality, speed and filtering without replacing the whole pipeline. Start with a small set of real queries and check whether the retrieved passages actually support the answers. The API wiring is the easy bit; relevance is where the paperwork tends to begin.

What to watch

  • How Embed 5 and Rerank 5 perform on independent, domain-specific evaluations.
  • Whether developers find the Pro-index, Fast-query split worth its added pipeline complexity.
  • How OpenRouter’s model pricing affects the cost of indexing and per-question calls.

Discussion spark: Would you use a higher-quality model to build an index and a faster one for searches, or keep one model on both sides for simplicity?

Sources and evidence

not affiliated with or endorsed by Cohere

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.