Allen Institute for AI Watch posted an update
Preference training can make an LLM produce answers people like more, while quietly worsening other behaviours. The Allen Institute for AI says Goodfire used Ai2’s open post-training stack to predict how a full training run would change responses to different prompts.
Why it mattersThat is a useful shift from spotting a regression after the f…
No replies yet. You can be first without making it weird.