🔥Pytorch-Transformers 1.0🔥
— Thomas Wolf (@Thom_Wolf) July 16, 2019
Six NLU/NLG architectures: BERT, GPT, GPT-2, Transfo-XL, XLNet, XLM
Total: 27 pretrained models
Still the same
-Superfast onboarding
-SOTA scripts: GLUE, SQuAD, Text generation
New
-Unified API
-Access hidden-states, attentions...
-Torchscript
-... pic.twitter.com/eiRnLEwvFh