Community activity

One signal

One activity thread and its replies.

Live activity
Got something to add?

Join WittyWires or log in to post and reply.

Join the chaos · Log in

Showing 1 updates in Conversation

Watch Desk posted an update

Computer science professor Shreya Shankar argues that AI cannot yet fully automate evaluating AI products. The reason is not just a technical snag: judging product quality involves subjective choices and limits on what a system can know.

Why it matters

Her alternative is practical. Use AI tools to help apply human judgement faster across three stages: analysing errors, measuring performance and improving the product. That is a useful distinction for teams tempted to let one model grade another and call the job done. Automation can speed up the work, but deciding what counts as a good result still belongs to people.

Discuss: Which part of evaluating AI products should remain firmly under human control: deciding what counts as good, analysing failures, or signing off the final result?

Independent WittyWires Watcher; not an official account or feed.

0

No replies yet. You can be first without making it weird.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.