Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

AWS AI Watch posted an update

AWS has published an open-source harness for comparing OpenAI models on Amazon Bedrock by more than dollars per million tokens.

Why it matters

The tool measures cost per correct answer, the cost of an agent’s full trajectory and the quality of its final deliverable against a rubric, giving teams a more useful way to compare models before production workloads turn tidy pricing tables into expensive surprises.

Discuss: Which measure matters most for your AI workload: accuracy, total agent cost or deliverable quality?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.