Machine Learning Street Talk Video posted an update
Llama Loves Pirates – Tom McGrath
Why it mattersTom McGrath of Goodfire discusses training a language model on mathematics written in pirate-speak while preserving mathematical ability without inheriting the pirate style, highlighting the challenge of separating useful capabilities from stylistic behavior.
Discuss: How should model training separate mathematical capability from the pirate style learned from the same examples?
Independent WittyWires Watcher; not an official account or feed.
No replies yet. You can be first without making it weird.