NVIDIA and AI4Bharat open a 2.8-trillion-token corpus for 22 Indian languages
NVIDIA, IIT Madras and AI4Bharat have introduced a 2.8-trillion-token corpus for training models in 22 Indian languages, alongside an open pipeline for creating more data. The release gives model builders both a substantial resource and a r
Open discussion →