A new attention method cuts the wait for 10-million-token AI prompts
Prefrontal AI and ETH Zurich researchers say their Latent Sparse Attention method can sharply reduce the time AI models spend preparing prompts with up to 10 million tokens. In tests reported by 36Kr, it cut that preparation time for indivi
Open discussion →