Tweeted By @AlecRad
The DL CV community is having a "oh wait, bags of local features are a really strong baseline for classification" moment with the BagNet paper.
— Alec Radford (@AlecRad) February 11, 2019
This has always been clear for text classification due to n-gram baselines. It took an embarrassingly long time for nets to beat them.