EN
BosanskiDeutschEnglish
Log in Download free
Guide · chapter 07

Schedules, segments and crawl comparison

Schedule a crawl to start on its own, split your site into segments and compare two crawls to see what has changed.

2 min readUpdated 21 October 2026

Schedules

A schedule starts a crawl on its own, at the time you set, saves the exports to a folder and, if you want, sends you the result on Telegram or by email.

  1. Open Schedules and click to add a new schedule.
  2. Choose the site and a settings preset, e.g. the same one you use for manual crawls of that site.
  3. Set the time: daily, weekly, or a cron expression for anything else.
  4. Choose the exports that go to the folder after each crawl, and who gets the message.
The app must be running. A schedule starts while SEO Bee is running on your computer. For crawls while the app is closed, use the command line and Windows Task Scheduler.

Keeping old crawls

A weekly schedule fills your disk quickly. The Keep last N rule deletes older crawls automatically, after every finished crawl and every night at 03:00. A locked crawl is never deleted, and neither is one that is still running.

Segments

A segment is a group of URLs defined by rules: e.g. "blog" for everything under /blog/, "products" for /p/. Once you set them up, you see the number of URLs with an issue in each segment. Clicking the number opens those URLs. That way you see straight away whether duplicate titles are a problem on the blog or in the shop.

Crawl comparison

In Crawl comparison you pick two crawls of the same site and see what was added, removed or changed: titles, response codes, canonicals, indexability.

If the new crawl ran on a staging address, enter the real domain and SEO Bee compares paths rather than full addresses. It's the fastest way to see what broke before a redesign goes live.

Next: command line and MCP.