Tweeted By @karpathy

lots of exciting recent work in large-scale distributed training of neural nets: (very) large-batch SGD, KFAC, ES, population-based training / ENAS, (online) distillation, ... 🔥

— Andrej Karpathy (@karpathy) May 27, 2018