
Web crawlers find most pages by following links. A sitemap.xml file gives them a second route: a list of the URLs you want crawled, with the date each one last changed. It helps most on large sites, new sites and pages with few internal links. Listing a URL doesn’t make a search engine index it, though.
The format comes from the sitemaps.org protocol, which the major search engines support. A minimal file looks like this:
The file must be UTF-8, and characters such as ampersands in URLs must be escaped. Most sites serve it from the root, at /sitemap.xml.
| Tag | Required? | What it does | How Google treats it |
|---|---|---|---|
urlset | Yes | Wraps the whole file | Required |
url and loc | Yes | One entry per page, with its full URL | Crawls the URL exactly as written |
lastmod | No | Date the page last changed | Used if consistently and verifiably accurate |
changefreq | No | How often the page is expected to change | Ignored |
priority | No | Relative importance within the site | Ignored |
Google’s sitemap guidelines say it ignores priority and changefreq. The protocol itself calls changefreq a hint. An accurate lastmod is the optional tag that earns its place.
One sitemap can list up to 50,000 URLs and must stay under 50MB uncompressed. Larger sites split their URLs across several files and list those files in a sitemap index:
An index can reference up to 50,000 sitemaps. Splitting by section, such as products and blog posts, also lets you read indexing data per section in Search Console.
A sitemap entry is also a weak canonical signal, so listing the wrong version of a duplicate works against you. Indexability covers the signals that decide which version gets stored.
Indirectly, yes. A sitemap helps search engines discover and refresh pages, and AI answers built on those indexes can only cite what’s in them. Google’s AI Overviews and AI Mode draw on Google’s index, and Microsoft Copilot draws on Bing.
Bing has been explicit about it. In a July 2025 post on sitemaps in AI-powered search, Bing described lastmod as a freshness signal it uses to decide which URLs to recrawl. It asked for ISO 8601 dates that include the time, and recommended pairing sitemaps with IndexNow.
A sitemap still isn’t written for language models. For a curated summary of your best content aimed at AI tools, see llms.txt.
Accurate dates pay off most when you update pages on purpose. Our post on refreshing content for AI search covers how to plan those updates.
A sitemap gets pages discovered, and Ansvisor shows whether they’re then cited. Its Site Audit checks robots.txt, canonical URLs and freshness signals on each page. Answer tracking then shows when updated pages start appearing as sources in ChatGPT, Gemini, Perplexity and Google’s AI features.
Each prompt you win brings more mentions, more citations and more buyers. Ansvisor keeps finding the next one.
Sitemap.xml is an XML file, usually at the root of a site, that lists the URLs you want search engines to crawl. It follows the sitemaps.org protocol and can include each page’s last modified date. Search engines treat it as a hint, not a command.
Only urlset, url and loc are required. The optional tags are lastmod, changefreq and priority. Google uses lastmod when it is consistently accurate and ignores changefreq and priority, so an accurate lastmod is the optional tag worth keeping.
One sitemap can list up to 50,000 URLs and must be no larger than 50MB uncompressed. Bigger sites split URLs across several sitemaps and list them in a sitemap index file, which can reference up to 50,000 sitemaps.
Add a “Sitemap:” line with the full URL to robots.txt, which any crawler can read. Then submit the sitemap in the Sitemaps report of Google Search Console and in Bing Webmaster Tools to see processing errors and last read dates.
Indirectly. A sitemap helps search engines find and refresh pages, and AI answers built on those indexes can only cite pages that are there. Bing has said accurate lastmod dates help it decide what to recrawl. A sitemap does not guarantee indexing or citations.
See how AI answers describe your brand, find out why competitors get picked, and close the gaps with AI agents that work alongside your team.
14-day free trial or 50% off your first month with code SAVE50.
Continue exploring key AI visibility concepts.
Measure and improve how often your brand appears in AI-generated answers.
Learn more →Strategies for increasing visibility in answer engines and AI summaries.
Learn more →Optimizing content for AI-powered discovery experiences.
Learn more →Understand how OpenAI retrieves and synthesizes information.
Learn more →AI-generated summaries that appear directly in Google Search.
Learn more →Explore how Perplexity cites and presents sources.
Learn more →References and sources used by AI systems to support answers.
Learn more →Measure the quality and influence of cited sources.
Learn more →How easily AI systems can discover and reuse your content.
Learn more →New terms are added regularly.
Help us improve the page or suggest a new term →
Co-founder at Ansvisor
Cihan Geyik is the co-founder of Ansvisor, an open-source AI Visibility platform for AI Search. With more than 15 years of experience in digital marketing and growth, he writes about AI visibility, AI search, AEO, GEO, citations, and answer engines. He focuses on helping brands understand and improve their presence across ChatGPT, Gemini, Google AI Overviews, Bing AI Mode and other AI answer engines.
Add Ansvisor as a preferred source and Google will show you more of our AI search, AEO and GEO guides.
© 2026 Ansvisor. All rights reserved. Ansvisor is an open-source AI Search Execution Platform for AI Visibility. Ansvisor is a brand owned and operated by Empler AI Inc.
The open-source AI Search Execution Platform. Track how AI answers talk about your brand and act on it.
Open source · MIT license© 2026 Ansvisor, a brand of Empler AI Inc. · 1401 PE Ave. Unit 105, Wilmington, DE 19806, United States
Cookie preferences
We use cookies to keep the site working and, with your OK, to measure traffic and improve our marketing. Read our Cookies & Tracking policy.