Crawl Log
Count the AI crawlers that read your site and the visitors AI assistants send you, on WordPress, Ghost or any other site.
Crawl Log records two things: AI crawlers like GPTBot, ClaudeBot and PerplexityBot reading your pages, and people arriving from ChatGPT, Claude, Perplexity and other AI assistants. The counts show on AI Crawlers and AI Visibility in your dashboard.
We only receive the page path, the user agent and the referrer of AI visits. No IP addresses, cookies or personal data, and ordinary visits are never sent. Like the WordPress plugin, we count page loads only: images, scripts, files like robots.txt, error pages and redirects are left out.
WordPress
- 1Install the Zivooo plugin (version 1.1.0 or later) from WordPress.org.
- 2Connect it in Zivooo under Setup → Publishing. That connection is how we read your counts.
- 3In WordPress, open Zivooo → Settings and turn on AI traffic.
- 4We read the counts every night, so the first ones show the next day.
Ghost and any other site
In Zivooo, open Setup → Crawl Log and click Create my keys. This creates the keys that link the visits to your site. Then pick one of the methods below. The script snippet works everywhere but only sees visitors, because crawlers don't run scripts. To count crawlers, add one of the server-side methods as well.
| Method | Counts | Works on |
|---|---|---|
| Script snippet | AI visitors | Any site, Ghost included |
| Cloudflare Worker | AI crawlers and AI visitors | Sites behind Cloudflare |
| Vercel log drain | AI crawlers and AI visitors | Sites on Vercel Pro |
| Next.js middleware | AI crawlers and AI visitors | Any Next.js site |
Script snippet
- 1Copy the snippet from Setup → Crawl Log.
- 2Paste it just before </body> on every page. On Ghost: Settings → Code injection → Site footer.
Cloudflare Worker
- 1In Cloudflare, open Workers & Pages and create a Worker.
- 2Replace its code with the Worker code from Setup → Crawl Log and deploy it.
- 3Under the Worker's Settings → Domains & Routes, add a route for your site, such as example.com/*.
Workers Free covers 100,000 requests a day. A busier site needs Workers Paid ($5 a month). The Worker passes every request through untouched, so visitors never wait on Zivooo.
Vercel log drain
- 1In Vercel, open Team Settings → Drains (or Log Drains) and start a new drain for your project's request logs.
- 2When Vercel shows a verification token, paste it into Setup → Crawl Log and save.
- 3Finish creating the drain with the endpoint URL and the custom header name and value shown in Setup → Crawl Log.
Next.js middleware
- 1Add an environment variable named ZIVOOO_AI_TRAFFIC_KEY with the key from Setup → Crawl Log.
- 2Save the middleware code as middleware.js at the root of your project. If you already have one, merge the two.
- 3Redeploy.
On Next.js 16 or later, middleware is called proxy: save the file as proxy.js and rename the middleware function to proxy.
Check that it works
Setup → Crawl Log shows Active once the first AI visit arrives, usually within a minute of it happening. A site that AI crawlers haven't found yet can stay on Waiting for a few days.
If you create a new key
The old key stops working at once. Update your Cloudflare Worker, Vercel drain or middleware with the new key, or those visits are not counted. The script snippet uses a separate site key and keeps working.