Tweeted By @dcpage3
Recent papers have studied the Hessian of the loss for deep nets experimentally:
— David Page (@dcpage3) September 11, 2019
(@leventsagun et al) https://t.co/JNJKeqZyvZ, https://t.co/Wbk3sSbIbr
(Papyan) https://t.co/l4QcB85nir.
(@_ghorbani et al) https://t.co/VUxknF5QkM compare what happens with and without BN.