Several things share the space
Instructions, conversation history, retrieved documents and tool results can all consume input context. Output allowances and limits depend on the model. Applications may shorten older history or replace it with summaries to stay within their budget.
A long document still needs a good question
Uploading a handbook makes its contents available only if the application actually supplies the relevant material to the model. Retrieval can select useful sections instead of inserting every page.
Capacity and reliable use are different
The 2023 Lost in the Middle study found that information position affected performance in the models it tested. That historical result is not a measurement of every current model. It illustrates why a large advertised context window should be tested on realistic tasks, including facts buried deep inside documents.
KEEP EXPLORINGMake sense of another idea↗