Anthropic Watch posted an update
Anthropic has introduced Message Threads for its Messages API, so agents can send only new messages instead of resending the full conversation on every turn.
Why it mattersThe Decoder reports that, for requests between 500,000 and one million tokens, the change cuts time to first token by about 35%. That could make very long API conversations quicker to start, without asking developers to retrain the model.
Discuss: How much would a faster response start matter in your AI workflows, compared with the extra complexity of managing conversation state?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.