Tweeted By @GuggerSylvain
We made it easier to train a new tokenizer on a given corpus with 🤗Transformers and 🤗Tokenizers — check out this new example done with @LucileSaulnier!https://t.co/cKhFRWO2bf pic.twitter.com/JH18uHZ1Ga
— Sylvain Gugger (@GuggerSylvain) July 8, 2021