Skip to content
DocsSite CrawlerScheduling Automated Crawls
Site Crawler

Scheduling Automated Crawls

Automate your website's broken link detection with PerfBee's scheduled crawls. Set up recurring scans to ensure a healthy site and improve your SEO.

2 min readUpdated Mar 9, 2026

Scheduling Automated Crawls

Regularly auditing your website for broken links is crucial for maintaining a positive user experience and preserving your search engine rankings. PerfBee’s Site Crawler allows you to automate this process with scheduled crawls. This article guides you through setting up and managing your scheduled scans.

Why Schedule Recurring Crawls?

Scheduling recurring crawls ensures that you’re proactively identifying and fixing broken links, redirect chains, and other issues that can negatively impact your website's performance and SEO. By automating this process, you can save time and ensure your site is always in top shape.

Setting Up a Schedule with the Wizard

To schedule a crawl, navigate to the Broken Links tab in your PerfBee dashboard. Then, go to the Scheduled tab. Here's how to set up a new schedule:

  1. Click the "Add Schedule" button to launch the multi-step wizard.
  2. Choose your desired crawl configuration preset.
  3. Select the frequency of your crawl: daily, weekly, or monthly.
  4. Configure your email notification preferences.
  5. Review and confirm your schedule settings.

Frequency Options

PerfBee offers flexible scheduling options to suit your needs:

  • Daily: Crawl your site every day.
  • Weekly: Crawl your site on a specific day of the week.
  • Monthly: Crawl your site on a specific day of the month.

Selecting a Preset

Each scheduled crawl uses a preset configuration. Presets define the scan depth, the types of checks performed (e.g., broken links, redirects, missing alt text), and other settings. Choose a preset that aligns with your desired level of detail and the resources available in your plan.

Email Alerts

PerfBee automatically sends email alerts when new broken links or other issues are detected since the last scheduled run. These notifications help you quickly address any problems and maintain a healthy website.

Run Now

Need to check your site immediately? The "Run Now" button allows you to trigger a crawl without waiting for the next scheduled time. This is useful for verifying recent changes or quickly addressing urgent issues.

Viewing Schedule History

You can view the history of your scheduled runs in the Scheduled tab. This history shows past runs, including a summary of the results. This allows you to track progress over time and identify any recurring issues.

Back to DocsWas this helpful? Contact support