Code Safari

Expedition 01·Beginner

What 'Generative' Actually Means: Next-Token Prediction, Explained Simply

01 / 06

The one idea

It predicts the next token. That's it.

A generative model is trained to answer one question over and over: given everything so far, what comes next? Every paragraph it writes is that single guess, repeated hundreds of times in a row.

What 'Generative' Actually Means: Next-Token Prediction, Explained Simply | Code Safari