Skip to content
Plumb
Light theme onCheck a URL

Sitemap Generator

Crawl a site and build its XML sitemap, or build one from a CSV of URLs and their language alternates; then notify search engines of updates. How it Works

Try

1

Crawl a Site

Follows links from your home page (up to 2,000 pages), robots.txt respected; optionally starts from the current sitemap.

2

Only Indexable Pages

200 HTML pages that aren't noindex or canonicalised elsewhere; every other URL listed with the reason.

3

Ready to Publish

XML with lastmod, changefreq, priority and images as you choose, a URL list, hreflang sitemaps from a CSV, and IndexNow.

Notify Search Engines of Changes

Google and Bing retired their sitemap “ping” URLs in 2023. Submit sitemaps once in Google Search Console and Bing Webmaster Tools; they re-read them regularly, using lastmod to spot changes.

For immediate notice, IndexNow tells Bing, Yandex, Seznam, Naver and Yep which URLs changed. Publish a text file containing your key at the root of the site (for example https://example.com/<key>.txt), then submit URLs here.

A Real Example

Checked 17 November 2026

https://www.scrapethissite.com/

What the tool found
The crawl found 52 URLs and put 3 in the sitemap: the home page, /pages/ and /login/. 45 were left out as noindex, since the practice pages such as /pages/simple/ and their 24 ?page_num= variants carry a meta robots noindex; 2 answered HTTP 400 and 2 are blocked by robots.txt (/faq/ and /lessons/).
What to do
A short sitemap is right here: it should list only pages meant to be indexed. The one to question is /login/, which rarely belongs in search: noindex it, or delete its entry before publishing the file.
Run This Example

Reading the Result

  • In the Sitemap

    A 200 HTML page that isn't noindex and doesn't point its canonical elsewhere: the only kind of URL a sitemap should list.

  • noindex and Canonical Elsewhere

    Pages whose own tags say not to index them, or to index another URL. Listing them would contradict those tags, so if one should be indexed, fix the tag rather than the sitemap.

  • Redirects, Error Status and No Response

    URLs that don't answer 200 themselves. A redirect's target is listed in its own right when it's on the site; errors are worth a look with the broken link checker.

  • robots.txt, Path Pattern, Depth Limit and Page Limit

    URLs that weren't requested, so nothing is known about them. If Page limit appears, the crawl stopped early: raise the limit before publishing the file.

What it Can't Tell You

  • It lists what the crawl reached by following links in the HTML as served, up to 2,000 pages. Pages linked only from scripts, or not linked at all, are missed unless you also start from the current sitemap.
  • Google ignores priority and changefreq, and uses lastmod only when it's consistently accurate. The server's Last-Modified header, used by default, is often the time of the request rather than of the last real change.