On the Theoretical Limitations of Embedding-based Retrieval
Orion Weller, Michael Boratko, Iftekhar Naim, et al.
This paper proves that single-vector embedding models have a fundamental dimension-dependent limit on the number of distinct top-k subsets they can represent, and shows this limitation arises even in simple realistic queries.