Preprint2406
Sparser is faster and less is more: Efficient sparse attention for long-range transformers
Unknown
This paper introduces a novel sparse attention mechanism that improves efficiency and performance for long-range transformers.
0Jan 1, 2406TransformersAttention Mechanisms
arXiv