Gradient
A numerical value which adjusts the parameters of a model. How much it adjusts is controlled by the learning rate.
The gradients update the parameters by multiplying the two together. How much the gradients update the parameters is controlled by the learning rate.
A positive gradient tells us that increasing the parameters will increase the loss. On the other hand, decreasing the parameters will decrease the loss.
A negative gradient tells us that decreasing the parameters will increase the loss On the other hand, increasing the parameters will decrease the loss.
Back to top