How do I track GPTBot and ClaudeBot visits?
+
Upload your server’s access log, or connect Cloudflare. Bot Tracker counts the visits of GPTBot, ClaudeBot and 8 more search and AI crawlers per day, crawler and page. Before you upload, run the one-line command from the upload card on your server: it keeps only the crawler lines.
Which crawlers does Bot Tracker count?
+
These ten: Googlebot, Bingbot, GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, Claude-SearchBot, PerplexityBot and Perplexity-User. Each one has a row, also when it never came. A training crawler may come only once a month, so a quiet crawler is not always a problem.
How does it tell a real Googlebot from a fake one?
+
It compares the address of each logged visit with the list of addresses the crawler’s operator publishes. A visit that matches is proved. A visit that does not match is fake: it is shown on its own and left out of every other count. If an operator’s list was too old to trust when your log was read, those visits are counted and marked as not proved.
Which log formats can I upload?
+
An nginx or Apache access log, a Cloudflare Logpush file of HTTP requests (one JSON object per line), or a CloudFront or IIS log in W3C extended format. A file is up to 50 MB, gzip or plain text, and the log needs the user agent of each visit.
Does PerfBee keep the IP addresses in my log?
+
No. The address of each visit is used only to check the crawler’s claim, and is not saved. PerfBee keeps counts per day, crawler and page, and never user agents, log lines, referrers, cookies or query values. The file is deleted when it has been read. The counts stay for as many days as your plan’s history, at most 365.
What does the Cloudflare connection read?
+
Once a day, how many requests came from the ten crawlers, by page address, crawler and status group, up to 30 days back. The token needs two read-only permissions. PerfBee never asks Cloudflare for IP addresses, reads no cookies or query strings, and never changes your Cloudflare account. Because Cloudflare gives no address, these visits are counted by user agent only.
Which plan includes Bot Tracker, and what does it cost?
+
Bot Tracker is on Starter and up and uses no credits. The 14-day Business trial includes it.
Which days does it show?
+
The 30 days that end at the newest day in your logs, not at today, because a log is usually uploaded once in a while. Every screen says which days it shows.
What if my site is behind a CDN or proxy?
+
The log may then show the address of the CDN and not the visitor. Bot Tracker says so in a banner and counts everything that calls itself a crawler. A log from your own server with the visitor address, or the CDN’s own log, gives a proved answer.
How is Bot Tracker different from AI Readiness?
+
AI Readiness reads your robots.txt and your pages after each completed detailed crawl, and says whether AI search engines can access and read them. Bot Tracker reads your log and shows which crawlers actually came, next to what robots.txt allows each AI crawler.