Glossary
Attention
How a model works out which earlier words each word should listen to. For every word it looks back over the text, weighs the others by how relevant they are, and pulls in meaning from the ones that matter — that's how it figures out what a word like "it" refers to. It's the core mechanism inside a transformer.
Related terms
See it in action
Don't just read the definition — play with it
Every term shows up in a lesson where you can poke at it live — free, right in the app.