Verifying Your Site

Verifying a site proves that your workspace controls it. You do not need it to scan a site or for the owned-site price: every site in My Sites gets that. You need it for the options that only a site's owner should have.

What verification unlocks

On the Starter plan and up, a verified site gets two options:

• Ignore robots.txt in the scan form. Your own scans of that site then also read the pages its robots.txt disallows. See Crawl Speed, Robots.txt and Owned-Site Pricing.
• Staging access: a user name and password, or request headers, that PerfBeeBot sends to that site only. See Crawling a Staging or Password-Protected Site.

Verify a site

1. Open My Sites and click the site.
2. Find the Ownership card. Pick one of the three methods and copy the value under Values to copy.
3. Publish the value on your site, then click Check now.

The value is the same every time you open the card, so you can publish it first and check later.

DNS record

Add a TXT record in your DNS. Put it at _perfbee.your-site.com or at your-site.com itself, with the value perfbee-site-verification=… from the card. DNS changes can take a while to show up. If the check fails at first, try again later.

HTML file

Upload a text file to the root of the site. Its name is perfbee-….txt and its content is the value from the card. It must open at https://your-site.com/perfbee-….txt.

Meta tag

Add this tag inside the <head> of your home page, with the value from the card:

<meta name="perfbee-site-verification" content="…">

How the check works

• PerfBeeBot checks from its crawler address, 169.58.21.218. For the file and the meta tag, your firewall must let it in. It follows your robots.txt for these requests too.
• A redirect to another site does not count. The file or the tag must be on the site you verify.
• One verification covers one site. www.your-site.com and your-site.com count as one site. A subdomain such as shop.your-site.com is a separate site and needs its own verification.

Staying verified

PerfBee checks a verified site again every week, so keep the record, file or tag in place. If a check fails, the card shows Check failing and PerfBee tries again every day. After three failed checks over at least 72 hours, the site is no longer verified and PerfBee notifies you. Ignore robots.txt and staging access then stop working for that site until you verify it again.

To stop, click Remove verification in the card. You can verify the site again at any time.