Learning Rate

The learning rate is a hyperparameter that controls how much the model's internal parameters are adjusted with each batch of training data.

A higher learning rate means the model makes bigger changes with each update, which can be faster but also riskier.

A lower learning rate means the model makes smaller changes, which can be slower but more careful.

Finding the right learning rate helps the model learn effectively without making too many mistakes.