How to create an XML sitemap from a crawl

A good XML sitemap contains only the pages you want in Google: ones that respond with 200, aren't noindex, aren't canonicalised to another address and don't redirect. SEO Bee builds it from a crawl and leaves out the rest by itself.

Steps

1. Crawl the site in Whole site mode. If the site builds its content with JavaScript, turn on rendering, otherwise the crawler won't see every link.
2. Open XML sitemap from the crawl. Above the options it says how many addresses go into the sitemap.
3. Choose the options: whether to include lastmod, changefreq and images. One sitemap covers one domain; addresses on other domains are left out, and the tool tells you how many there are.
4. Download the sitemap. Over 50,000 addresses, you get a ZIP with several files and a sitemap index. For the index, enter the address of the folder where the sitemaps will sit on the server.
5. Upload the file to the server, add the line Sitemap: https://your-site/sitemap.xml to robots.txt and submit it in Search Console.

Check an existing sitemap

If the site already has a sitemap, turn on Read XML sitemaps before the crawl. The Sitemaps tab then shows:

• Indexable, not in sitemap: pages that should be in it.
• Non-indexable in sitemap: noindex pages, redirects and canonicalised addresses that don't belong in the sitemap.
• Orphan (sitemap only): addresses no internal link leads to.
• In multiple sitemaps, Sitemap over 50,000 URLs, Sitemap over 50 MB.

Next