Tweeted By @ak92501
An Attention Free Transformer
— AK (@ak92501) June 1, 2021
pdf: https://t.co/iOURQMubTR
abs: https://t.co/6TSsVXmjww
an efficient variant of Transformers that eliminates the need for dot product self attention pic.twitter.com/ZfaIbdmvnL