Tweeted By @ak92501

∞-former: Infinite Memory Transformer
pdf: https://t.co/4B4sxwGEM5
abs: https://t.co/sBtFRIv7rc

propose the ∞-former, which extends the vanilla transformer with an unbounded long-term memory pic.twitter.com/0oFWpixF3b

— AK (@ak92501) September 2, 2021