Tweeted By @JeffDean
Everything you wanted to know about the effects of batch size on neural net training behavior but were afraid to ask!
— Jeff Dean (@JeffDean) November 9, 2018
Measuring the Effects of Data Parallelism on Neural Network Training
Chris Shallue, Jaehoon Lee, Joe Antognini, @jaschasd, Roy Frostig, George Dahl @GoogleAI https://t.co/6TUbthAfai