Tweeted By @Smerity

If we look back on many of our standard methods in ML (RNNs, dropout, word vectors, residual networks, ...) almost all had underlying theory and explanation that was both motivated by and clarified due to clear experimental science. Insane this is still not recognized.

— Smerity (@Smerity) July 30, 2018