training
Batch Normalization
A technique that normalizes the inputs to each layer of a neural network across a mini-batch during training. Batch normalization stabilizes and accelerates training by reducing internal covariate shift, allowing higher learning rates.
In practice
Adding batch normalization layers helped train deeper networks like ResNet-152 that would otherwise be difficult to optimize.