Tweeted By @Jeande_d
Learning rate is one of the most important hyperparameters to adjust well during the ML model training.
— Jean de Nyandwi (@Jeande_d) November 12, 2021
A high learning rate can speed up the training, but it can cause the model to diverge. A low rate can slow the training.
Here are different learning rate curves pic.twitter.com/GsGf4phRaA