Tweeted By @Thom_Wolf
๐Pytorch-Transformers 1.2.0 is out!๐
โ Thomas Wolf (@Thom_Wolf) September 4, 2019
A new architecture:
- DistilBERT from @huggingface ๐https://t.co/5ANj4OyJfL
Five new pretrained checkpoints:
- DistilBERT base & SQuAD
- GPT2 large 774M
- XLM multilingual 17 & 100 languages
So many fixes/improvements from the community! pic.twitter.com/1hCDKfJpwC