TechnicalAI glossary
Autoregressive model
A model that produces its output piece by piece, each piece taking into account all the previous ones. That's how text models work, and more recently, how the best image generators work: it's what finally allows them to write correct text within an image.
In other words
Write a sentence word by word, rereading the whole thing from the start, rather than revealing it all at once.
Alyriaz articles that mention it
- A model that writes a text in one go instead of word by word
Diffusion models applied to text generate an entire response in parallel rather than word by word. We explain the principle, its speed advantages and its limitations.