Tweeted By @OriolVinyalsML
Rapid unsupervised learning progress thanks to contrastive losses, approaching supervised learning!
— Oriol Vinyals (@OriolVinyalsML) February 14, 2020
-40% Multitask SSL https://t.co/3HXS53l71v (2017)
-50% CPC https://t.co/k55jv1bAj3 (2018)
-70% AMDIM/MOCO/CPCv2/etc (2019)
-76.5% SimCLR https://t.co/y7WitlTOl7 (2020, so far) pic.twitter.com/z1Q1yPi9pO