Transformers

Learnable Masked Tokens for Improved Transferability of Self-Supervised Vision Transformers
ECML PKDD 2022 - Learnable masked tokens reduce overfitting when training transformers in low-data regime.
Hao Hu, Federico Baldassarre, Hossein Azizpour
PDF Cite
Learnable Masked Tokens for Improved Transferability of Self-Supervised Vision Transformers