Transformers

Variable Rate Allocation for Vector-Quantized Autoencoders
ICASSP 2023 - Control the bit rate allocation of a a PQ-VAE using semantic information from DINO, in collaboration with the Meta AI in Paris.
Federico Baldassarre, Alaaeldin El-Nouby, Hervé Jégou
Cite Poster
Variable Rate Allocation for Vector-Quantized Autoencoders
Learnable Masked Tokens for Improved Transferability of Self-Supervised Vision Transformers
ECML PKDD 2022 - Learnable masked tokens reduce overfitting when training transformers in low-data regime.
Hao Hu, Federico Baldassarre, Hossein Azizpour
PDF Cite
Learnable Masked Tokens for Improved Transferability of Self-Supervised Vision Transformers