AI Crawler Events Resource

Daily counts of AI crawler visits (GPTBot, ClaudeBot, PerplexityBot, Bingbot, Amazonbot, and more) recorded from sites where you installed crawler tracking. Each row is one day's hit total for a single crawler on a single path and HTTP status code.

Endpoint:

GET /api/v1/crawler-events

This resource is only populated once you install crawler tracking on a site (Settings → Connections → Website tracking). See AI Crawler Tracking for setup.

Filters

Key fields

• site_key_id: the tracked site the visit was recorded for
• event_date: UTC day of the visits (YYYY-MM-DD)
• crawler_id: stable crawler identifier (e.g. gptbot)
• crawler_org: operating company (e.g. OpenAI)
• path: the request path the crawler hit
• status_class: HTTP status class of the crawled responses (2xx to 5xx), or unknown when the install cannot determine the response status. Vercel middleware installs report unknown for all requests. Empty only when no status was reported at all.
• status_code: the exact HTTP status (for example 200, 301, or 404), or 0 when the install did not report one
• hits: number of visits that day for this crawler + path + status code
• last_seen_at: timestamp of the most recent visit counted in this row

Example

curl -H "Authorization: Bearer $AEO_API_KEY" \
  "https://app.citlyze.com/api/v1/crawler-events?crawler_id=gptbot&since=2026-06-01"

CSV export is supported with ?format=csv. Rows are ordered by event_date (newest first); paginate with limit and offset.

Use this resource to chart AI crawler traffic over time, attribute visits to specific pages, find pages answering crawlers with errors, and compare which engines crawl you most.

AI referrals

Human visits that arrived from an AI answer are captured by the same tracking install and exposed at their own endpoint. See AI Referrals.