AI Crawler Events Resource

Daily counts of AI crawler visits (GPTBot, ClaudeBot, PerplexityBot, Bingbot, Amazonbot, and more) recorded from sites where you installed crawler tracking. Each row is one day's hit total for a single crawler on a single path and HTTP status class.

Endpoint:

GET /api/v1/crawler-events

This resource is only populated once you install crawler tracking on a site (AI Crawlers → Install tracking). See AI Crawler Tracking for setup.

Filters

Key fields

• site_key_id: the tracked site the visit was recorded for
• event_date: UTC day of the visits (YYYY-MM-DD)
• crawler_id: stable crawler identifier (e.g. gptbot)
• crawler_org: operating company (e.g. OpenAI)
• path: the request path the crawler hit
• status_class: HTTP status class of the crawled responses (2xx to 5xx), or unknown when the install cannot determine the response status. Vercel installs report unknown for all requests; the WordPress plugin reports 404 or unknown. Empty only when no status was reported at all.
• hits: number of visits that day for this crawler + path + status class
• last_seen_at: timestamp of the most recent visit counted in this row

Example

curl -H "Authorization: Bearer $AEO_API_KEY" \
  "https://app.citlyze.com/api/v1/crawler-events?crawler_id=gptbot&since=2026-06-01"

CSV export is supported with ?format=csv. Rows are ordered by event_date (newest first); paginate with limit and offset.

Use this resource to chart AI crawler traffic over time, attribute visits to specific pages, find pages answering crawlers with errors, and compare which engines crawl you most.

AI referrals

Human visits that arrived from an AI answer are captured by the same tracking install and exposed at their own endpoint. See AI Referrals.