AI & Infrastructure
Context Window

Context Window

A context window is the maximum amount of text, measured in tokens, that an AI model can read and use in one request. It covers the prompt, the conversation so far, retrieved documents and the answer itself.
June 26, 2026
Cihan Geyik
Table of Content

When an answer engine writes about your category, it doesn’t read the web. It reads a short packet of passages that its search step placed in the model’s context window. Whatever misses that packet can’t shape the answer or earn a citation. That makes the context window the last gate between a page that ranks and a page that gets cited.

Working memory for one answer. Training data is what a model learned months ago. The context window holds what it can see right now, and only that can be quoted or cited.

What is a context window?

Anthropic’s documentation calls the context window the model’s "working memory". It holds all the text a model can reference while it writes a response, including the response itself. Size is counted in tokens. OpenAI estimates one English token at about four characters, or three quarters of a word.

Google uses a similar picture and calls the window short-term memory. Its long-context guide says many Gemini models take 1 million tokens or more. By Google’s count, that’s about 50,000 lines of code or eight average-length English novels.

Model context window vs training data

"Model context window" means the same thing: the limit set for one specific model. People confuse it with training data. Training data shaped the model’s weights before release and stops at a cutoff date. The window is filled fresh for every request and cleared afterward.

Chat apps that seem to remember earlier turns put those turns back into the window, or store summaries outside it. Long chats eventually push old turns out.

What fills the context window in AI search?

PartWhat it holdsWho controls it
System instructionsRules for tone, safety and citationsThe engine
Conversation historyEarlier prompts and repliesThe user
Retrieved passagesChunks from search results for the promptSearch and ranking systems
Tool resultsOutput from searches, code or other toolsThe engine
The answerTokens the model writesThe model

Only the retrieved passages come from publishers. That slice shares the window with everything else.

How does an answer engine fill the window?

Prompt → Search runs one or more queries → Results split into passages → Best passages packed into the window → Model writes and cites from them

Engines rarely paste whole pages. They select passages, so your best paragraph competes with other sites’ paragraphs. Content retrieval covers how passages get picked. RAG covers the architecture around it.

Is a bigger context window better?

Not automatically. The 2023 paper "Lost in the Middle" found performance is often highest when the relevant facts sit at the beginning or end of the input. It degrades when the model has to use facts buried in the middle, even in models built for long inputs.

Anthropic’s docs name the wider effect context rot: accuracy and recall fall as the token count grows. Google adds that its near-perfect recall results come from finding one fact. When a model must find several, it doesn’t reach the same accuracy. More room helps, but what goes into the window still decides the answer.

What does it mean for your content?

  • Answer each section’s question in its first one or two sentences, so the passage works when read alone.
  • Name the brand and product in each passage. "It" and "our tool" lose meaning once a chunk is cut from the page.
  • Keep pricing, limits and integrations in plain text near the top of the relevant section.
  • Use descriptive headings, so each passage maps to one question.

These habits raise a page’s retrievability. Our guide to optimizing content for answer engines works through them with examples.

Why context limits still matter for brands

Large windows haven’t removed selection. Running a model on a million tokens costs more and takes longer, which gives answer engines a reason to keep packets small. Google’s guide notes that the input token cost is paid again for every query. The AI answers we track cite about 7.2 links each, across 103,427 answers. Source: Ansvisor tracking data, September 15 to October 14, 2026. Every passage you publish competes for one of those few slots in an LLM answer.

How Ansvisor helps

Ansvisor’s Site Audit checks pages against 47 weighted AEO and GEO signals. Its content checks cover direct answers, answer-first structure, readability and entities. Those are the traits that let a passage hold up once it’s lifted out of the page. Many fixes come with copy you can paste.

Model Context Window, Context Length, Token Window, LLM Context Size, Context Limit

Let AI Search Work for Your Growth

Each prompt you win brings more mentions, more citations and more buyers. Ansvisor keeps finding the next one.

AI Answers Mentions Citations Visibility Score AI Share of Voice AI Traffic Revenue
Win Back Search VisibilityTry Ansvisor 14-day Free →✓ Zero risk. Cancel anytime.

FAQ

Frequently asked questions.

What is a context window in AI?

A context window is the amount of text a language model can consider at one time, counted in tokens. Everything in the request uses it: instructions, chat history, retrieved documents and the model’s own reply. Text outside the window is invisible to the model for that answer.

How big are context windows today?

Many Gemini models accept 1 million tokens or more, and several current Claude models also have a 1 million-token window. Google says 1 million tokens is about eight average-length English novels. Some models still work with windows of 200,000 tokens.

Is a bigger context window always better?

No. Research shows models use information at the start and end of a long input better than information in the middle. Anthropic calls the broader drop in recall as inputs grow “context rot”. Picking the right passages still matters more than fitting in more text.

How many words is a token?

In English, one token is about four characters, or roughly three quarters of a word, according to OpenAI. So 100,000 tokens is around 75,000 words. Exact counts depend on the model’s tokenizer and the language.

Does the context window affect which pages AI search cites?

Indirectly. An answer engine retrieves many results but passes only selected passages into the model’s context, and it cites from those. Pages whose answers sit in short, self-contained passages are easier to select and use.

Help us grow the AI Visibility Glossary

New terms are added regularly.

Help us improve the page or suggest a new term →
About the Author
Cihan Geyik

Cihan Geyik

Co-founder at Ansvisor

Cihan Geyik is the co-founder of Ansvisor, an open-source AI Visibility platform for AI Search. With more than 15 years of experience in digital marketing and growth, he writes about AI visibility, AI search, AEO, GEO, citations, and answer engines. He focuses on helping brands understand and improve their presence across ChatGPT, Gemini, Google AI Overviews, Bing AI Mode and other AI answer engines.

Google Preferred Sources
Get more Ansvisor insights in Google

Add Ansvisor as a preferred source and Google will show you more of our AI search, AEO and GEO guides.