Expedition 05·Beginner
Tokens, Context Windows, and Why AI Sometimes Forgets
01 / 06
Tokens
AI reads in chunks, not letters.
Text is split into tokens — usually whole words, sometimes word-pieces. The model never sees individual letters, which is why it struggles to count letters or spell backwards.