ForBo7 // Salman Naqvi
  • Home
  • ForBlog
  • Playground
  • Dictionary
  • About

Learning Rate

A numerical value which controls how much the gradients update the parameters of a model.

The learning rate controls how much the gradients adjust the parameters by multiplying the learning rate and gradients together.

Note

A learning rate that is too high can cause the training system to either get stuck in a loop or diverge from the optimal weights.

A learning rate that is too low can cause the training system to take a very long time to reach the optimal weights.

ForBo7 // Salman Naqvi © 2022 and ForBlog™ by Salman Naqvi | Site Version 2.0.3.1 | Site Feedback | Website made by me!