training
Learning Rate
A hyperparameter that controls the step size of parameter updates during training. A higher learning rate enables faster training but risks overshooting optimal values, while a lower rate is more precise but slower to converge.
In practice
Starting with a learning rate of 0.001 and gradually reducing it during training is a common strategy called learning rate decay.