Preprint2024
Papers Explained 187e: Quantized Llama 3.2, Llama 3.3
Unknown
Meta's quantized Llama 3.2 and Llama 3.3 models reduce size and memory via QAT with LoRA and SpinQuant, enabling deployment on mobile devices.
0Oct 1, 2024Quantization
AI Research
AI & ML Research Papers
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.
Quantization
12 papersPreprintarXiv.org2024
Model quantization and hardware acceleration for vision transformers: A comprehensive survey
D. Du, Gu Gong, Xiaowen Chu
A comprehensive survey of model quantization and hardware acceleration techniques for vision transformers.
22May 1, 2024TransformersQuantization
arXiv
Preprint2024
Intactkv: Improving large language model quantization by keeping pivot tokens intact
Ruikang Liu, Haoli Bai, Haokun Lin, et al.
Intactkv improves large language model quantization by preserving pivot tokens, achieving state-of-the-art results.
0Jan 1, 2024Large Language ModelsQuantization
arXiv
ConferenceInternational Conference on Machine Learning2025
GuidedQuant: Large language model quantization via exploiting end loss guidance
Jinuk Kim, Marwa El Halabi, Wonpyo Park, et al.
GuidedQuant improves post-training quantization of large language models by using end-loss guidance to better preserve model accuracy.
19Jan 1, 2025Large Language ModelsQuantization
arXiv
Preprint2024
Llmc: Benchmarking large language model quantization with a versatile compression toolkit
Unknown
This paper introduces Llmc, a versatile toolkit for benchmarking LLM quantization methods, enabling standardized evaluation and comparison.
0Jan 1, 2024Large Language ModelsReasoning
PreprintInternational Conference on Learning Representations2024
Leanquant: Accurate and scalable large language model quantization with loss-error-aware grid
Tianyi Zhang, Anshumali Shrivastava
Leanquant introduces a loss-error-aware grid quantization method for LLMs that achieves accurate and scalable compression by minimizing quantization error with respect to the model's loss function.
26Jul 1, 2024Large Language ModelsQuantization
arXiv
Preprint2021
Mqbench: Towards reproducible and deployable model quantization benchmark
Yuhang Li, Mingzhu Shen, Yan Ren, et al.
Mqbench provides a reproducible and deployable benchmark for model quantization to accelerate deep learning inference.
71Jan 1, 2021BenchmarksQuantization
arXiv
Preprint2025
Ostquant: Refining large language model quantization with orthogonal and scaling transformations for better distribution fitting
Xing Hu, Yuan Cheng, Dawei Yang, et al.
Ostquant improves LLM quantization by applying orthogonal and scaling transformations to better fit weight distributions, reducing accuracy loss.
0Jan 1, 2025Large Language ModelsScaling Laws
arXiv
Preprint2024
Retraining-free model quantization via one-shot weight-coupling learning
Unknown
Proposes a retraining-free model quantization method using one-shot weight-coupling learning to achieve efficient compression without fine-tuning.
0Jan 1, 2024Quantization
Preprint2025
Low-bit model quantization for deep neural networks: A survey
Kai Liu, Qian Zheng, Kaiwen Tao, et al.
This survey provides a comprehensive overview of low-bit model quantization techniques for deep neural networks, including a curated list of resources.
0Jan 1, 2025QuantizationNeural Networks
arXiv
Preprint2023
A comprehensive survey on model quantization for deep neural networks in image classification
Unknown
This survey comprehensively reviews model quantization techniques for deep neural networks in image classification, covering methods, challenges, and future directions.
0Jan 1, 2023QuantizationNeural Networks
PreprintProceedings of the ACM on Computer Graphics and Interactive Techniques2024
Reducing the Memory Footprint of 3D Gaussian Splatting
Panagiotis Papantonakis, Georgios Kopanas, Bernhard Kerbl, et al.
This paper reduces the memory footprint of 3D Gaussian splatting by 27x via resolution-aware pruning, adaptive spherical harmonic coefficients, and codebook quantization.
207May 11, 2024Quantization
arXiv