DictionaryContext Management
Attention Budget
How much the AI can truly focus on, which is often less than how much it can technically hold.
Definition
The effective amount of context a model can meaningfully attend to. While context windows may be large (200K to 1M+ tokens), attention quality degrades with length. The practical attention budget is often smaller than the raw token limit.
Example
A model with a 1M-token window may still miss a rule buried at token 400K, so keep key instructions short and prominent.