training

Activation Function

A mathematical function applied to the output of each neuron that introduces non-linearity into the network. Without activation functions, a neural network would be equivalent to a linear model regardless of its depth.