Several things share the space

Instructions, conversation history, retrieved documents and tool results can all consume input context. Output allowances and limits depend on the model. Applications may shorten older history or replace it with summaries to stay within their budget.

A long document still needs a good question

Instructions+History + documents+Question

Uploading a handbook makes its contents available only if the application actually supplies the relevant material to the model. Retrieval can select useful sections instead of inserting every page.

Capacity and reliable use are different

The 2023 Lost in the Middle study found that information position affected performance in the models it tested. That historical result is not a measurement of every current model. It illustrates why a large advertised context window should be tested on realistic tasks, including facts buried deep inside documents.

KEEP EXPLORINGMake sense of another idea↗