Preprint2022
DiT
Unknown
An Image Transformer pre-trained via self-supervision on document images for improved representation learning.
0Mar 1, 2022Transformers
AI Research
AI & ML Research Papers
A comprehensive index of artificial intelligence and machine-learning research with AI-generated summaries, citation metrics, and direct links to papers and code.
All Papers
3 papersPreprint2021
Masked AutoEncoder
Unknown
An encoder-decoder architecture that reconstructs input images by masking random patches and leveraging a high proportion of masking for self-supervision.
0Nov 1, 2021Computer Vision
Preprint2020
Knowledge distillation meets self-supervision
Unknown
This paper integrates knowledge distillation with self-supervised contrastive learning to improve student model performance without requiring labeled data.
0Jan 1, 2020Knowledge DistillationComputer Vision