Tweeted By @ak92501

Are Pre-trained Convolutions Better than Pre-trained Transformers?
pdf: https://t.co/8L06XiPM1C
abs: https://t.co/gIAq2Od5GA

experimental results show that convolutions can outperform Transformers in both pretrain and non-pre-trained setups pic.twitter.com/IZtYlBXvkc

— AK (@ak92501) May 10, 2021