Tweeted By @sedielem
Good advice! For classification models, a scatter plot of the cross-entropy loss vs. prediction entropy (~confidence) for individual examples can be very revealing.
— Sander Dieleman (@sedielem) October 2, 2020
More generally: study model behaviour for individual data points, don't look at aggregate statistics exclusively. https://t.co/8BPF780BzC