How AI Works

It predicts the next token. Over and over again.

An interactive walk-through — in 8 small steps — of the one idea every modern AI runs on.

The One Idea: Predict the Next Token

The AI knows a probability between every token and every other token — about 200,000 in total.

A token is a piece of text. "tokenization" → "token" + "ization"

{token}
[10346]
{ization}
[2860]
{emb}
[2072]
{eddings}
[32861]
{transform}
[19692]
{er}
[259]
{under}
[11093]
{standing}
[12138]

Real substring tokenization:

"tokenization" → {token}+{ization}"embeddings" → {emb}+{eddings}"transformer" → {transform}+{er}"understanding" → {under}+{standing}

8 interactive steps · Real tokenization · Live AI predictions