Skip to content
Site Crawler

Running Your First Site Crawl

2 min read · Updated Oct 25, 2026

Discover how to use PerfBee's Site Crawler to identify broken links, redirects, and SEO issues on your website. This guide provides step-by-step instructions to get you started.

Running Your First Site Crawl

PerfBee's Site Crawler helps you identify and fix issues affecting your website's performance and SEO. It scans your site for broken links and redirect chains, and a Detailed scan adds SEO checks such as missing alt text, duplicate titles, and missing meta descriptions, allowing you to improve user experience and search engine rankings.

Key Benefits

  • Find Broken Links: Identify 4xx and 5xx errors that hurt user experience.
  • Detect Redirect Chains: Optimize redirects for faster page loading.
  • Uncover SEO Issues: Find missing meta descriptions, duplicate titles, and more with a Detailed scan.
  • Schedule Recurring Scans: Stay on top of issues with automated daily, weekly, or monthly crawls. Daily crawls need the Business plan or higher.

How to Run a Site Crawl

Follow these steps to get started:

  1. Navigate to the Site Crawler: Log in to your PerfBee dashboard and click Site Crawler in the sidebar. The Scan tab opens.
  2. Select Your Site: In the Site field, select the site you want to crawl. Only sites in My Sites can be scanned, so add your site there first (e.g., https://yourwebsite.com). If the site's address includes a folder, the crawl stays inside that folder.
  3. Select a Scan Preset: Under Start from, choose a preset or this site's last scan. It fills in the mode (Fast or Detailed), JavaScript rendering and the other settings, and you can change any of them before you start. The default preset is a good starting point. Consult our documentation for details on scan modes and credit costs.
  4. Start the Crawl: Click the "Start scan" button.
  5. Watch Real-Time Progress: The crawl will run in the background, and the Scans tab shows its progress as pages are crawled. You do not need to wait for the entire scan to complete to view the results: the report of a running scan shows what it has found so far.
  6. View Results: Open the scan's report from the Scans tab. You can view results in the following tabs:
    • Summary: Provides an overview of the issues found, why the crawl stopped, and what to fix first.
    • All URLs: Shows every URL the crawl checked; the Broken filter lists all broken links detected.
    • SEO: Highlights SEO-related problems (Detailed scans).
    • Redirects, Duplicates, Technical, CSS/JS, Images and AI Readiness: More reports from a Detailed scan.

Credit Costs

The credit cost for a site crawl depends on the scan mode (fast or detailed), on JavaScript rendering, and on whether you verified the site in My Sites (a verified site costs half). The Credit estimate next to the scan form shows about what a scan will cost before you start, and the pricing page lists the costs. Remember that your credit balance is always visible in the top-right of the dashboard.