Skip to content
DocsSite CrawlerRunning Your First Site Crawl
Site Crawler

Running Your First Site Crawl

Discover how to use PerfBee's Site Crawler to identify broken links, redirects, and SEO issues on your website. This guide provides step-by-step instructions to get you started.

2 min readUpdated Mar 9, 2026

Running Your First Site Crawl

PerfBee's Site Crawler is a powerful tool designed to help you identify and fix critical issues impacting your website's performance and SEO. It automatically scans your site for broken links, redirect chains, missing alt text, duplicate titles, and missing meta descriptions, allowing you to improve user experience and search engine rankings.

Key Benefits

  • Find Broken Links: Identify 4xx and 5xx errors that hurt user experience.
  • Detect Redirect Chains: Optimize redirects for faster page loading.
  • Uncover SEO Issues: Find missing meta descriptions, duplicate titles, and more.
  • Schedule Recurring Scans: Stay on top of issues with automated daily, weekly, or monthly crawls.

How to Run a Site Crawl

Follow these steps to get started:

  1. Navigate to the Broken Links Tab: Log in to your PerfBee dashboard and click on the "Broken Links" tab.
  2. Enter a Starting URL: In the designated field, enter the URL of the page you want to start crawling from (e.g., https://yourwebsite.com).
  3. Select a Scan Preset: Choose a scan preset. These presets determine the depth and thoroughness of the crawl. The default preset is a good starting point. Consult our documentation for details on scan modes and credit costs.
  4. Start the Crawl: Click the "Start Scan" button.
  5. Watch Real-Time Progress: The crawl will run in the background. You'll see real-time progress updates as pages are crawled. You do not need to wait for the entire scan to complete to view the results.
  6. View Results: As the crawl progresses, results will begin to populate within the Broken Links tab. You can view results in the following sections:
    • Summary: Provides an overview of the issues found.
    • Broken Links: Lists all broken links detected.
    • SEO Issues: Highlights SEO-related problems.
    • All Pages: Shows a list of all crawled pages.

Credit Costs

The credit cost for a site crawl depends on the scan mode (fast or detailed) and whether the site is verified as owned. Review the credit costs in the PerfBee documentation or in the "Credit System" section of our marketing site: https://perfbee.com. Remember that your credit balance is always visible in the top-right of the dashboard.

Back to DocsWas this helpful? Contact support