TechnicalAI glossary
Loss in the middle
On a long text, a model's attention is not distributed evenly: the beginning and end are well handled, while the middle is skimmed over. This phenomenon has been measured, and it explains why a report's summary mainly reflects its introduction and conclusion.
In other words
The passenger who listens to the start and end of the briefing, and tunes out in the middle.
Alyriaz articles that mention it
- What is the "context window"? The working memory that decides what your AI can actually understand
The context window is the amount of information an AI can hold in mind at once. We explain this key concept simply, why it exploded in 2026 (up to 2 million tokens), and why a large context doesn't solve everything.