Skip to content

training

Bias (Neural Network)

A learnable parameter added to the weighted sum of inputs in a neuron, allowing the model to shift the activation function. Bias terms provide additional flexibility, enabling the model to fit data that doesn't pass through the origin.

In practice

Without a bias term, a neuron's output would always be zero when all inputs are zero, limiting what the model can learn.