Preprint2022
Flan T5, Flan PaLM
Unknown
Explores scaling instruction fine-tuning by increasing tasks, model size, and incorporating chain-of-thought data to improve language model performance.
0Oct 1, 2022Chain Of ThoughtScaling Laws
arXiv
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.
Unknown
Explores scaling instruction fine-tuning by increasing tasks, model size, and incorporating chain-of-thought data to improve language model performance.
Jason Wei, Maarten Bosma, Vincent Y. Zhao, et al.
Instruction tuning on 62 NLP datasets with natural language templates enables a 137B parameter model to achieve strong zero-shot performance on unseen tasks.