Understanding sitemap.txt: A simple plain-text sitemap for discovery

What is sitemap.txt?

A sitemap.txt is a simple plain-text file that lists your site's URLs, one per line. Unlike XML sitemaps, it doesn't carry metadata like last modified dates or crawl frequencies. It's a lightweight option for basic URL discovery.

Format and contents

Each line contains a full URL to a page on your site. List canonical URLs, avoid duplicates, and keep the file updated as pages come and go. The file should be publicly accessible, typically at the site root or another standard location.

When to use it

If you want a quick, low-friction way to help search engines discover pages, or you can't serve XML sitemaps yet, a sitemap.txt can be a helpful starting point. It complements, not replaces, a full XML sitemap.

How search engines use sitemap.txt

Discovery vs. indexing

Search engines fetch sitemap.txt and read the URLs, then crawl those pages. It does not provide priority or change frequency like an XML sitemap.

Limitations and caveats

Because it lacks metadata, search engines infer signals from the pages themselves. Not having a sitemap.txt does not prevent indexing; good site structure and internal linking matter too.

Practical tips for creating and maintaining sitemap.txt

Creating a sitemap.txt

Create a plain text file with one URL per line. Use https URLs when possible and ensure the listed URLs are canonical and publicly accessible.

Validation and hosting

Place the file at https://example.com/sitemap.txt (or another public location). Ensure each URL returns 200 and is not blocked by robots.txt. Update the list as the site changes.

When to refresh

Add new pages as soon as they go live; remove stale URLs. There is no mandated refresh cadence, but consistency helps crawlers.

Common questions about sitemap.txt

Does sitemap.txt affect SEO?

It can aid discovery but provides no metadata. Its impact is generally smaller than XML sitemaps and depends on crawl behavior and site structure.

Are there risks or downsides?

Listing non-canonical or restricted pages can waste crawl budget or reveal private paths. Keep the file clean and public-friendly.