Preprint2024
Nemotron-4 340B
Unknown
Nvidia's Nemotron-4 340B models and reward model enable synthetic data generation for training smaller language models, with over 98% of alignment data being synthetic.
0Jun 1, 2024Alignment
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.
Unknown
Nvidia's Nemotron-4 340B models and reward model enable synthetic data generation for training smaller language models, with over 98% of alignment data being synthetic.
Unknown
Nvidia's Nemotron-4 15B is a multilingual language model trained on 8 trillion tokens, achieving strong performance across English, code, and multilingual tasks.