Loading
The fixed token budget the model sees, input and output together.
In a picture
Everything the model sees has to fit in one window of tokens.
The model attends only to what is inside the window.
Old turns fall out; the model cannot see them any more.
Stage 1 of 3: Fill
Open the full conceptMade for you now: slide lessons from basics to production, usually with code and a quiz. See a finished one