training

Softmax

An activation function that converts a vector of raw scores into a probability distribution, where all values sum to 1. Softmax is typically used in the final layer of classification models and in attention mechanisms.