Glossary
Tokenization
The step that splits your text into tokens before the AI reads it. Common words become a single token; rarer or longer ones break into several pieces.
Related terms
See it in action
Don't just read the definition — play with it
Every term shows up in a lesson where you can poke at it live — free, right in the app.