What an embedding is

A list of numbers that captures meaning.

Every token is turned into a long list of numbers — a vector. Tokens with similar meanings get similar vectors, so meaning becomes geometry the model can compute with.