Tweeted By @GaelVaroquaux
We investigate what features of tabular data explain the difference, for this, we modify tabular data to narrow the gap.
— Gael Varoquaux (@GaelVaroquaux) July 19, 2022
Smoothing the outcome in feature space narrows the gap: deep architectures struggle with irregular patterns. Tree models do not care about smoothness
6/9 pic.twitter.com/NlyvuzwlgD