Start a 14-day Brand Starter trial with no credit card
ai crawler tracking

See which AI engines visit your site

GEO Audits check whether AI crawlers can reach your pages. AI Crawler Tracking records which bots visit, how often they visit, and which pages they request.

14-day Brand Starter trial · No credit card required

AI crawler traffic

Signed server-side requests · last 30 days

Live

2,442

crawler hits

86

URLs requested

GPTBot

top crawler

Daily hits

+22%
Jun 1Jun 8Jun 15Jun 30

Bot breakdown

GPTBotOpenAI1,184
PerplexityBotPerplexity746
ClaudeBotAnthropic318
Google-ExtendedGoogle194

One score across the major AI answer engines

  • ChatGPT
  • Gemini
  • Perplexity
  • DeepSeek
  • ByteDance
  • Grok
  • Google AI Overview
  • Google AI Mode

AI crawler traffic

Signed server-side requests · last 30 days

Live

2,442

crawler hits

86

URLs requested

GPTBot

top crawler

Daily hits

+22%
Jun 1Jun 8Jun 15Jun 30

Bot breakdown

GPTBotOpenAI1,184
PerplexityBotPerplexity746
ClaudeBotAnthropic318
Google-ExtendedGoogle194
real crawler traffic

Measure AI bot visits

Track GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and other crawlers over time. See which engines request your content.

  • Daily AI crawler hits over time
  • Per-bot breakdown with organization and purpose
  • Top crawler and trend at a glance
Start free trial

Crawler request log

Server-side capture from the edge

Receiving

Cloudflare

worker

Vercel

middleware

WordPress

plugin

TimeBotRequested URLStatus
12:04GPTBot/compare/field-serviceSigned
11:47ClaudeBot/blog/dispatch-schedulingSigned
11:31PerplexityBot/pricingSigned
10:58Google-Extended/customers/routepilotReview
server-side capture

Catch the crawlers a JS pixel misses

AI training crawlers do not run JavaScript, so a GTM tag misses them. The server-side snippet reads the request User-Agent and counts supported bot traffic.

  • Edge snippet for Cloudflare and Vercel
  • Honest coverage notes on JS/GTM beacons
  • Detects 20+ AI crawler user agents
Start free trial

Site connection

asterflow.com · AI crawler tracking

Receiving events

Cloudflare

capture method

2 min ago

last verified hit

94%

signed requests

Setup checks

Workspace key createdAsterFlow production
Complete
Cloudflare worker installedRequests signed at the edge
Complete
Crawler events receivedGPTBot, PerplexityBot, ClaudeBot
Live
Unknown user agents3 awaiting review
Review

Recent verified hits

GPTBot/field-service-scheduling2 min ago
PerplexityBot/compare/routepilot8 min ago
ClaudeBot/blog/dispatch-planning14 min ago
one-snippet install

Set up in minutes, no developer required

Generate a key ID and signing secret, then paste one server-side snippet or install the WordPress plugin. Setup tabs cover Cloudflare, Vercel, WordPress, and Shopify or Webflow proxy setups.

  • Signed server-side snippets per platform
  • Downloadable WordPress plugin
  • Per-site keys you can revoke anytime
Start free trial
FAQ

AI crawler tracking

Want a demo of Citlyze? Book a demo

AI crawler tracking shows which answer-engine bots request your pages. Citlyze records signed server-side requests from bots such as GPTBot, ClaudeBot, PerplexityBot, Google-Extended, and other supported crawlers so your team can see which URLs AI systems are fetching.

Does AI recommend you when buyers ask?

Track how ChatGPT, Gemini, Perplexity, DeepSeek, ByteDance, and Grok mention, cite, and rank your brand. See the answer buyers get and the gaps to close.

No credit card required · Starter limits apply during trial