Tweeted By @evolvingstuff

Neat idea: dropout where you randomly set some of the nonlinearities to being linear.

Drop-Activation: Implicit Parameter Reduction and Harmonic Regularizationhttps://t.co/09rlgo1fom pic.twitter.com/kz4NLObcQv

— Thomas Lahore (@evolvingstuff) November 15, 2018