Docschevron_rightSite Crawlerchevron_rightOwned Site Crawling & Verification
travel_exploreSite Crawler

Owned Site Crawling & Verification

Verify your website to unlock lower credit costs and gain a higher trust level with PerfBee's Site Crawler. This guide details how to verify your site using IP whitelisting or HTTP header verification.

schedule3 min readupdateUpdated Mar 9, 2026

Owned Site Crawling & Verification

Welcome to PerfBee! This guide explains how to verify your website as an "owned site" within our Site Crawler and the benefits you'll receive.

What Does "Owned Site" Mean?

When you verify your website as an owned site, you're telling PerfBee that you have explicit permission to crawl and analyze its content. This verification unlocks several advantages:

  • Lower Credit Costs: Crawling owned sites is significantly more cost-effective. You'll pay 0.5 credits per page for a fast scan or 1 credit per page for a detailed scan, compared to 1 and 4 credits respectively for non-owned sites. This can save you a lot of credits!
  • Higher Trust Level: Verification assures PerfBee that you're authorized to access and analyze the site's data, increasing the reliability of your scans.

Verification Methods

PerfBee offers two straightforward methods for verifying your ownership:

1. IP Whitelist

This method involves allowing PerfBee's server IP address in your website's firewall or Cloudflare configuration. This grants our crawler access.

  1. Identify PerfBee's server IP address: 173.212.236.185
  2. If you use Cloudflare, go to your DNS settings and add a firewall rule to whitelist this IP.
  3. If you use a different firewall (e.g., on your server), configure it to allow incoming connections from the PerfBee IP address.

2. HTTP Header Verification

This method uses an HTTP header to authorize PerfBee's requests. You'll need to configure your server (e.g., using Cloudflare rules or Nginx) to permit requests that include a specific header.

  1. Cloudflare: Create a Cloudflare WAF rule to allow requests containing the header X-PerfBee-Token. The specific value of the token doesn't matter, as PerfBee will automatically send the header.
  2. Nginx: If using Nginx, configure your server to allow requests with the header X-PerfBee-Token.

Important: PerfBee automatically includes the X-PerfBee-Token header when crawling your verified owned sites. You do not need to manually add the header.

Where to Find Verification Options and Check Status

You can find the options to verify your sites in the "My Sites" section of the PerfBee dashboard. After setting up verification, you can monitor the status of your site within the Site Crawler interface.

To access the PerfBee dashboard, visit: https://dashboard.perfbee.com

arrow_backBack to DocsmailWas this helpful? Contact support