Tweeted By @Thom_Wolf
I like @yoavgo experiments! Self-contained with open-code, they are an invitation to participate!
— Thomas Wolf (@Thom_Wolf) January 11, 2019
I've just added OpenAI GPT (by @AlecRad) to the BERT repo so I conducted a few LM vs. Masked-LM Transformer experiments.
Surprise: OpenAI GPT tops BERT on some experiments [1/3] https://t.co/DmOZExyBBu