Skip to content
JustTools

Sitemap Generator

Crawl your website the way a search engine does — or paste a list of pages — and download a clean sitemap.xml with only indexable URLs, real last-modified dates and optional images.

Looks up public records Free · no sign-up

At a glance

  • Crawls a website from its home page, following links on the same host — up to 1,000 pages — or builds a sitemap from a pasted list, a CSV or an existing sitemap.
  • Includes only indexable pages: it obeys robots.txt, and leaves out pages with noindex, a canonical pointing elsewhere, redirects and error statuses — listing each one with the reason.
  • Adds lastmod from the page’s own date (article:modified_time, JSON-LD dateModified) or the server’s Last-Modified header, or a date you choose.
  • Optionally adds images (Google image sitemap extension) and linked PDF files; changefreq and priority are optional because Google ignores them.
  • Splits large sites into several files with a sitemap index at the protocol’s 50,000-URL / 50 MB limit, and also exports a plain-text list.
  • Pages are fetched by your browser when the site allows it, otherwise through Jina Reader at about 18 pages a minute. Only page addresses are sent.

Step by step

How to create an XML sitemap

  1. 1

    Enter your website

    Type your home page address and choose how many pages to crawl, or switch to From a list of URLs.

  2. 2

    Let it crawl

    Pages are discovered through links; skipped pages are listed with the reason. You can stop at any time.

  3. 3

    Choose the details

    Pick where lastmod comes from and whether to add images; leave changefreq and priority out unless you need them.

  4. 4

    Upload and submit

    Download sitemap.xml, upload it to your site’s root, add it to robots.txt and submit it in Google Search Console and Bing Webmaster Tools.

Features

Everything you need, nothing you don’t

Crawls like Google

Follows links, respects robots.txt and nofollow, and only keeps pages that can actually be indexed.

Clean by default

No duplicates, no redirects, no noindex pages and no tracking parameters — the mistakes Search Console reports.

Honest lastmod

Dates come from the pages themselves, so Google can trust them to spot updates.

Image sitemaps

Add each page’s images to help them appear in Google Images.

Any size

Sitemap index and numbered files are made automatically for very large sites.

From a list too

Paste URLs or open a CSV or old sitemap to clean it up and rebuild it.

What belongs in a sitemap

IncludeLeave out
Pages that return 200 and that you want in search resultsPages with noindex, or blocked in robots.txt
The canonical version of each pageDuplicates, ?ref= and other tracking variants
The final address after redirectsURLs that redirect or return 404
Accurate lastmod datesDates that change on every build without a real update

Do I need a sitemap?

Search engines find most pages by following links, but a sitemap helps them discover new and updated pages faster — especially on new sites with few backlinks, large sites, and pages that few other pages link to. Google reads loc and an accurate lastmod; it ignores changefreq and priority.

After uploading, list the sitemap in robots.txt (Sitemap: https://example.com/sitemap.xml) so every search engine finds it, and submit it once in Google Search Console and Bing Webmaster Tools to see how many pages are indexed. Google no longer accepts sitemap “pings”; Bing and Yandex also support IndexNow for instant updates.

FAQ

Frequently asked questions

Is the sitemap generator free?

Yes, with no sign-up. Crawls are limited to 1,000 pages at a time; for bigger sites, crawl sections separately or use the URL list mode with an export from your CMS.

Why is the crawl slow for my site?

If your site doesn’t allow other websites to read its pages (most don’t), pages are fetched through Jina Reader, whose free service allows about 20 requests a minute — so 100 pages take around 6 minutes. Sites that allow it are crawled several pages at a time.

Why were some pages left out?

They can’t be indexed as they are: blocked by robots.txt, marked noindex, redirected, returning an error, or pointing to a different canonical URL. The “Pages left out” list shows the reason for each.

Should I set changefreq and priority?

Not for Google — it ignores both. They are optional and left out by default; an accurate lastmod is far more useful.

How many URLs can one sitemap hold?

50,000 URLs or 50 MB uncompressed. Larger sites need several sitemap files listed in a sitemap index, which the generator creates automatically.

Keep going

Browse every tool

Last updated Report a problem or suggest a feature