Lesson 1 of 9
The chat is one shared window
6 min read
You type a question, hit enter, and an answer appears. Simple. But behind that box your words don't vanish into some vast brain — they land somewhere small and specific. Knowing where changes how you use every AI chat.
Everything lands on one page
Picture a single sheet of paper the AI can see. When you send a message, it's written onto that sheet. When the AI replies, its answer goes on there too. Ask a follow-up, and that's added as well. The AI has no memory of you outside this one sheet — every time it answers, it quietly re-reads the whole thing from the top and continues from there. That shared sheet is the context window.
Your messages and the AI's replies share one growing page — the context window. The AI re-reads all of it on every turn, and knows nothing about you that isn't written there.
Your words become tokens
There's one more detail. The AI doesn't read your sentence as whole words the way you do. On the way in, your text is chopped into small chunks — a short word, or a piece of a longer one. Each chunk is a token. "Unbelievable" might arrive as un·believ·able, three tokens. The reply is built the same way, one token at a time. It's a background detail, but it's why the window has a limit — the limit is counted in tokens, not messages.
Your words are split into tokens — small pieces of text — before the AI ever sees them. The window's size is measured in tokens, which is why a very long chat eventually runs out of room.
Under the hood, if you're curious: assistants split text into tokens in slightly different ways, and a rough rule of thumb is that one token is about four characters of English — so a page of text is a few hundred tokens.
The gist
- —Everything you type and everything the AI replies lands on one shared page — the context window
- —The AI re-reads that whole page on every turn and has no memory outside it
- —Your text is split into tokens first, and the window's size is measured in tokens
You tell an AI your name in a chat, close the app, and open a brand-new chat the next day. You ask, "What's my name?" What happens?
Continue in the app
Take the whole Working with AI course — tracked
Get your personalized path, progress and streaks in the app — this lesson and every next one, in order.