Tweeted By @evolvingstuff
What an elegant idea:
— Thomas Lahore (@evolvingstuff) January 13, 2020
Choosing the Sample with Lowest Loss makes SGD Robust
"in each step, first choose a set of k samples, then from these choose the one with the smallest current loss, and do an SGD-like update with this chosen sample"https://t.co/mwZjnhJy92