Skip to content
Site Crawler

Scheduling Automated Crawls

2 min read · Updated Oct 14, 2026

Automate your website's broken link detection with PerfBee's scheduled crawls. Set up recurring scans to ensure a healthy site and improve your SEO.

Scheduling Automated Crawls

Regularly auditing your website for broken links is crucial for maintaining a positive user experience and preserving your search engine rankings. PerfBee’s Site Crawler allows you to automate this process with scheduled crawls. This article guides you through setting up and managing your scheduled scans.

Why Schedule Recurring Crawls?

Scheduling recurring crawls ensures that you’re proactively identifying and fixing broken links, redirect chains, and other issues that can negatively impact your website's performance and SEO. By automating this process, you can save time and ensure your site is always in top shape.

Setting Up a Schedule

To schedule a crawl, navigate to Site Crawler in your PerfBee dashboard. Then, go to the Scheduled tab. Here's how to set up a new schedule:

  1. Click the New schedule button. You can also click Schedule this scan on the scan form.
  2. Choose the site and its Scan settings: one of your presets, a PerfBee preset, or the settings on the scan form.
  3. Select the frequency of your crawl (daily, weekly, or monthly) and the day and time.
  4. Configure your email notification preferences.
  5. Check the estimated credits per run and click Save schedule.

Frequency Options

PerfBee offers flexible scheduling options to suit your needs:

  • Daily: Crawl your site every day.
  • Weekly: Crawl your site on a specific day of the week.
  • Monthly: Crawl your site on a specific day of the month (1 to 28).

The time you pick is in your time zone. Daily schedules need the Business plan or higher; on the Free and Starter plans, schedules run weekly or monthly.

Selecting a Preset

A scheduled crawl can use a preset configuration. Presets define the scan mode, JavaScript rendering, the types of checks performed (e.g., internal links, external links, images), limits and other settings. A schedule linked to a preset takes the preset's current settings before every run. Choose a preset that aligns with your desired level of detail and the credits available in your plan.

Email Alerts

Each schedule has its own email setting: Every run, Broken links only (an email when a run finds broken links) or Off, sent to the addresses you enter. A failed run is emailed too. Email alerts need the Starter plan or higher. PerfBee also adds an in-app notification when a run finishes.

Run Now

Need to check your site immediately? The "Run now" button in a schedule's row allows you to trigger a crawl without waiting for the next scheduled time. This is useful for verifying recent changes or quickly addressing urgent issues.

Viewing Schedule History

The Scheduled tab shows each schedule's next run and the result of its last run; click that result to open the run's report. Every run is also listed in the Scans tab, so you can track progress over time and identify any recurring issues.