Tokenizer Playground
Visualise how text splits into LLM-style tokens. Coloured token highlights plus chars/4 and words/0.75 length estimates side by side.
Visualise how text splits into LLM-style tokens. Coloured token highlights plus chars/4 and words/0.75 length estimates side by side.