autoregressive generation

autoregressive generation

/ˌɔːtoʊrɪˈɡresɪv ˌdʒenəˈreɪʃən/

🧠 LLM Architecture

producing output one token at a time, where each token depends on all previous tokens

Autoregressive generation means the model can't revise earlier words once they're written.

Origin: Greek auto- self + Latin regressus return + generare to produce