architectures
Autoregressive Model
A model that generates output one element at a time, conditioning each prediction on all previously generated elements. Most language models are autoregressive, predicting the next token based on the sequence of tokens already produced.
In practice
When GPT writes text, it generates one word at a time, each word influenced by all the words before it.