Skip to content
For agencies

A cloud SEO crawler for agencies

Crawl every client site from the cloud. Send clients reports with your logo, and give your team the same crawls to work on.

Try Business free for 14 days. No card.

Start for freeMove your client sites over

Every client site, crawled in the cloud

  • Nothing to install

    Crawls run on PerfBee’s servers. A scheduled crawl runs while your computer is off.

  • One page list per site

    Site Pages keeps every URL your crawls of a site found, with its status, indexability and issues.

  • What changed since the last crawl

    A scheduled crawl is compared with the one before: new and fixed broken links, and after a detailed crawl, new, gone and changed pages.

Site Pages: 1,694 of 1,813 pages, with chips for OK, broken, deep and not linked pages, and each page’s status, indexability and issues.

A crawler your clients’ firewalls can verify

  • PerfBeeBot

    A named user agent, one published IP address and signed requests. PerfBeeBot is a Cloudflare verified bot.

  • Blocked is not broken

    When a firewall still blocks a page, it is marked not checked instead of broken, and it is not billed.

  • One page for the developer

    The PerfBeeBot page tells your client’s developer how to verify the crawler, slow it down or let it in.

How PerfBeeBot works
Not checked, by reason: 2 pages access denied and 1 rate limited. The crawler could not read them, so they are not counted as broken and were not billed.

Fix lists a developer can work through

  • What to fix first

    Issues are ranked by the pages they hurt and grouped by template and shared element, so a broken link in the menu is one fix.

  • Where each link sits

    Navigation, header, footer, sidebar or content, with the HTML element, in a detailed crawl.

  • Redirects for broken pages

    A suggested target for each 404 or 410 where a live page matches, downloadable as a redirect file (Starter and up).

What to fix first: 16 open issues. Number 1 is a broken link in a shared element linked from 1,772 pages; number 2 is mixed content on 84 pages.

A GEO audit for every client

  • Each AI bot against robots.txt

    14 AI bots checked one by one after each completed detailed crawl, with llms.txt and Content-Signal.

  • Pages AI answers cannot quote

    Listed, so you can show a client which pages to fix.

  • When a bot loses access

    You hear when an AI search bot that could reach the site no longer can.

On every plan, with no extra credits.

AI readiness report: 8 of 8 AI answer bots allowed by robots.txt, 1,750 of 1,772 pages AI can quote, and what each AI bot may read.

Your brand on what clients see

  • White-label PDF and Excel

    Save your logo, name and colour once. PDF and Excel exports carry them (Starter and up), and CSV file names start with your name.

  • A client page that keeps up

    One link per client site always shows its newest crawl in plain words, under your brand (Starter and up). Clients open it without an account.

  • A Google Sheet that keeps up

    A live link puts your newest crawl in a Google Sheet (Starter and up). Anyone who can open the sheet can read the data.

Your team and your tools on the same crawls

  • Roles for your team

    Admin, member and viewer roles on the same sites and crawls (Business and up). Each person signs in with their own account.

  • REST API and webhooks

    Read crawls, issues and pages as JSON and get a signed webhook when a crawl ends. On every plan.

  • Claude and ChatGPT

    Connect them to PerfBee through its MCP server to start crawls and read the results.

Move your client sites over

  1. Create a free account and start the 14-day Business trial from your dashboard.

  2. Add each client site in My Sites and start a crawl: fast for links and status codes, detailed for SEO and AI readiness.

  3. Save your logo, name and colour in Settings, then invite your team.

  4. Schedule each crawl so the next one runs by itself.

Coming from a desktop crawler? See PerfBee vs Screaming Frog and PerfBee vs Sitebulb.

FAQ

Questions agencies ask

Anything else? Talk to us.

Is there a free trial for agencies?

Every account can try Business for 14 days, free and with no card, once per account. Start it from your dashboard with one click once your email is confirmed. When it ends, the account moves to the Free plan and nothing is charged.

Can I send a client a white-label report?

Yes. Save your logo, name and colour in Settings. PDF and Excel exports carry them (Starter and up), and CSV file names start with your name. A client link gives each client one page under your brand that always shows the newest crawl, and a share link to one crawl shows your branding instead of PerfBee’s.

Can my team work on the same client sites?

Yes. A team workspace gives each person an admin, member or viewer role on the same sites and crawls (Business and up). Each person signs in with their own account.

What if a client’s firewall blocks the crawler?

PerfBeeBot crawls from one published IP address with signed requests, and it is a Cloudflare verified bot, so the client’s developer can let it in. A page that is still blocked is marked not checked, not broken, and it is not billed.

Can PerfBee crawl a client’s staging site?

Yes, behind its user name and password or a request header, on a site verified in My Sites (Starter and up).

How are crawls billed?

In credits, the same on every plan: a fast crawl uses 1 credit a page, a detailed one 2. On a site verified in My Sites, half.

More to read

Bring your first client site.

Try Business free for 14 days. No card.

Start for free

Start the trial from your dashboard once your email is confirmed.