Hugging Face TRL 1.16.0 brings training to Trainium and speeds up shared rollouts
Hugging Face’s TRL 1.16.0 adds AWS Trainium support and tree-based packing for asynchronous GRPO training, with the project reporting substantial speed and memory gains in its tests. It also adds support for AMD GPUs in asynchronous trainer
Open discussion →