AI Explorer

The model reads pieces of text from a fixed list of about 200,000.

Tap a token to see its ID. Long or rare words fall apart into several pieces.

Your text, cut into tokens

Real

Your text:The dog barked because it was hungry.

cut into 9 tokens, each with its ID

Tap a chip to see its ID and its size. A dot is a space that belongs to the token.

0Tokens
0Words
0Characters
0.0Chars / token
0Tokens in the list