ConferenceNeurIPS 20172017Featured
Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, et al.
Introduced the Transformer architecture, replacing recurrence and convolutions with self-attention mechanisms, achieving state-of-the-art results on machine translation and becoming the foundation for all modern large language models.
130kJun 12, 2017TransformersAttention Mechanisms
arXiv