Tweeted By @seb_ruder
Our RemBERT model (ICLR 2021) is finally open-source and available in 🤗 Transformers.
— Sebastian Ruder (@seb_ruder) August 23, 2021
RemBERT is a large multilingual Transformer that outperforms XLM-R (and mT5 with similar # of params) in zero-shot transfer.
Docs: https://t.co/AKwV0UF6cT
Paper: https://t.co/TXF7qlJtUY pic.twitter.com/ytIiMOqVks