Homepage
Close
Menu

Site Navigation

  • Home
  • Archive(TODO)
    • By Day
    • By Month
  • About(TODO)
  • Stats
Close
by jeremyphoward on 2019-08-15 (UTC).

"New State of the Art AI Optimizer: Rectified Adam (RAdam). Improve your AI accuracy instantly versus Adam, & why it works"
It's been a long time since we've seen a new optimizer reliably beat the old favorites; this looks like a very encouraging approach!https://t.co/1MZmTbmFjn

— Jeremy Howard (@jeremyphoward) August 15, 2019
research
by ryaneleary on 2019-08-15 (UTC).

@jeremyphoward Could I introduce you to Novograd? https://t.co/1U8psyl3Io Also consistently better results than SGD/Adam with half the memory footprint of Adam.

— Ryan Leary (@ryaneleary) August 15, 2019
research
by remykarem on 2019-08-24 (UTC).

Thanks for sharing, Jeremy. If anyone wants to see the difference between Adam and RAdam, I have highlighted them below. pic.twitter.com/Kef3q0oKAV

— Remy (@remykarem) August 24, 2019
research

Tags

learning tutorial misc nlp rstats gan ethics research dataviz survey python tool security kaggle video thought bayesian humour tensorflow w_code bias dataset pytorch cv tip application javascript forecast swift golang rl jax julia gnn causal surey diffusion
© Copyright Philosophy 2018 Site Template by Colorlib