Glossary

Context window

The context window is how much text a model can take in at once: the documents, the question, and the answer, all in tokens (a token is roughly three quarters of a word). Windows grew large in 2026 (128K to 1M), but effective use of long context is usually worse than the headline number, which is why retrieving only the relevant parts often beats stuffing everything in.

← All terms