Hugging Face TRL 1.15.0 brings a fused LM head and longer training sequences
Hugging Face’s TRL 1.15.0 makes a fused language-model head the default for several training methods, cutting memory use and allowing much longer sequences in the project’s tests. The release also adds practical training and logging changes
Open discussion →