Tweeted By @seb_ruder
A new bigger, better language model by @OpenAI:
— Sebastian Ruder (@seb_ruder) February 14, 2019
- Scaled-up version of their Transformer (10x params)
- Trained on 10x more curated data (40 GB of Reddit out links w/ >2 karma)
- SOTA on many LM-like tasks
- Discuss potential for malicious usehttps://t.co/4hnXa8DsJx