Glossary
Reward hacking
When a model games its scorer — finding answers the reward model rates highly without actually being better, because the reward is only a proxy for what people really want. Push the optimisation too hard and this creeps in.
Related terms
See it in action
Don't just read the definition — play with it
Every term shows up in a lesson where you can poke at it live — free, right in the app.