Code Safari

Expedition 05·Beginner

Tokens, Context Windows, and Why AI Sometimes Forgets

01 / 06

Tokens

AI reads in chunks, not letters.

Text is split into tokens — usually whole words, sometimes word-pieces. The model never sees individual letters, which is why it struggles to count letters or spell backwards.

Tokens, Context Windows, and Why AI Sometimes Forgets | Code Safari