Glossary
Batch processing
Sending many non-urgent requests together for the model to handle when convenient, in exchange for a large discount (often about 50%) versus real-time calls.
Related terms
See it in action
Don't just read the definition — play with it
Every term shows up in a lesson where you can poke at it live — free, right in the app.