Tweeted By @srush_nlp
"Transformer are .. more effective at machine translation than RNN models, but ... most of these quality gains were from the transformer encoder, and that the transformer decoder was not significantly better than the RNN decoder."https://t.co/lGiWB9abZN
— Sasha Rush (@srush_nlp) December 17, 2020
(not sure this is CW)