Tweeted By @jeremyphoward
"New State of the Art AI Optimizer: Rectified Adam (RAdam). Improve your AI accuracy instantly versus Adam, & why it works"
— Jeremy Howard (@jeremyphoward) August 15, 2019
It's been a long time since we've seen a new optimizer reliably beat the old favorites; this looks like a very encouraging approach!https://t.co/1MZmTbmFjn