We are releasing mT5: A massively-multilingual version of T5 that supports over π― languages! mT5 was pre-trained on a multilingual version of C4 and achieves SoTA on many cross-lingual NLP tasks.
β Adam Roberts (@ada_rob) October 23, 2020
πPre-print: https://t.co/lfQd9CeF7b
πΎCode/models: https://t.co/1MauV6etQY pic.twitter.com/LUJIFaMxF5