Tweeted By @Tim_Dettmers
I am excited to share my latest work: 8-bit optimizers – a replacement for regular optimizers. Faster 🚀, 75% less memory 🪶, same performance📈, no hyperparam tuning needed 🔢. 🧵/n
— Tim Dettmers (@Tim_Dettmers) October 8, 2021
Paper: https://t.co/V5tjOmaWvD
Library: https://t.co/JAvUk9hrmM
Video: https://t.co/TWCNpCtCap pic.twitter.com/qyItEHeB04