Expedition 01·Beginner
What 'Generative' Actually Means: Next-Token Prediction, Explained Simply
01 / 06
The one idea
It predicts the next token. That's it.
A generative model is trained to answer one question over and over: given everything so far, what comes next? Every paragraph it writes is that single guess, repeated hundreds of times in a row.