AI Tracking: Bots, LLM Mentions & Hallucinated URLs

Introduction to AI Tracking: Why It Matters

The Generative Engine Optimization era has created a new challenge for businesses: understanding how artificial intelligences interact with their website. Unlike SEO engines, AI bots crawl your site with different intentions and frequencies, LLMs cite your brand in their responses, and an entirely new referral traffic stream comes from AI assistants. Without comprehensive AI tracking, you are operating blind in a channel that already represents a growing share of your audience.

AI Labs Audit provides an integral tracking system covering four complementary dimensions: AI bot detection, LLM mention tracking, AI referral traffic analysis, and hallucinated URL detection. Together, these dimensions offer a 360-degree view of your presence in the AI ecosystem.

AI Bot Detection: How It Works

AI bots regularly visit your site to feed language model knowledge bases. Detecting and understanding these visits is the first step in an effective GEO strategy.

The Detection Mechanism

The tracking system analyzes every incoming request by examining:

• User-Agent: each AI bot has a unique User-Agent signature identifying it
• IP address: some bots come from known, verifiable IP ranges
• Navigation behavior: crawl patterns (frequency, pages visited, depth) differ between humans and bots
• HTTP headers: AI bots send specific headers enabling identification

15+ Major Signatures Detected

The system identifies the following bots among others:

• GPTBot: OpenAI's primary crawler feeding ChatGPT and GPT-4 knowledge
• ChatGPT-User: the bot used when ChatGPT browses the web in real-time to answer a user question
• ClaudeBot: Anthropic's crawler for Claude
• PerplexityBot: Perplexity's crawler, particularly active due to real-time web access
• Google-Extended: Google's bot dedicated to Gemini training, distinct from standard Googlebot
• Bytespider: ByteDance's crawler for AI model training
• Meta-ExternalAgent: Meta's bot for Llama and other AI model training
• Cohere-ai: Cohere's crawler for its language models
• Amazonbot: Amazon's bot for AWS AI services
• YouBot: You.com's crawler for its AI search engine
• AppleBot-Extended: Apple's bot for Siri and Apple Intelligence AI features
• Diffbot: a data extraction bot used by numerous AI services
• Timpibot: Timpi's crawler, a decentralized search engine
• OAI-SearchBot: OpenAI's search bot for SearchGPT functionality
• FacebookBot: for Meta AI services indexing

The Bot Signature Database

AI Labs Audit maintains a database of 126 AI bot signatures, constantly updated. Each bot is categorized by:

• Provider: the company behind the bot (OpenAI, Anthropic, Google, Meta, etc.)
• Category: usage type (training crawl, real-time search, data extraction, indexing)
• Typical frequency: the bot's usual crawl pattern (daily, weekly, continuous)
• GEO impact: the bot's importance for your AI visibility strategy (critical, important, informational)
• robots.txt directives: the bot's respect of robots.txt and how to configure it

Real-Time Crawl Event Logging

Every AI bot visit is recorded with granular detail:

• Precise timestamp: exact date and time
• Page visited: full URL of the crawled page
• Identified bot: name and category
• Response code: HTTP code returned (200, 301, 404, 403, 500...)
• Response time: server speed serving the bot
• Response size: data volume transferred

This logging detects anomalies: a bot receiving many 404s (structure problem), high response time (performance issue), or sudden absence of a regular bot (possible unintentional blocking).

LLM Mention Tracking: How Audits Detect Your Brand

The second tracking pillar monitors your brand mentions in language model responses, measured during GEO audits:

Multi-Model Detection

Each audit queries 300+ models with varied prompts about your brand, sector, and key themes. Responses are analyzed for direct mentions, indirect references, and competitor mentions (for competitive analysis).

Mention Quality Analysis

• Sentiment: positive, neutral, or negative? The sentiment score measures this.
• Position: where in the response? The average AI position is a key indicator.
• Context: recommendation, comparison, factual mention, or caveat?
• Frequency: the mention rate measures citation regularity.

AI Referral Traffic: Measuring What AI Sends You

AI referral traffic is the visitor stream arriving after interacting with a language model — the AI equivalent of organic search traffic.

How to Measure It

The tracking system identifies AI referral traffic by analyzing referrers from known AI domains (chat.openai.com, claude.ai, perplexity.ai, etc.), specific UTM parameters, and HTTP headers identifying traffic as AI-originated.

Referral Traffic Metrics

• Total AI referral visit volume (daily, weekly, monthly)
• Breakdown by source (ChatGPT, Claude, Perplexity, etc.)
• Most visited pages via AI referral
• AI referral bounce rate vs. standard traffic
• Time trends and evolution

Hallucinated URL Detection

As detailed in our dedicated hallucinated URLs article, AI tracking also includes detection of URLs invented by LLMs. This feature cross-references bot crawl data with audit-detected mentions to identify non-existent URLs cited by models.

Dashboard Views

Crawl Timeline

A chronological view of all AI bot visits, with filtering by bot, page, and response code. Visualize crawl patterns and detect anomalies.

Bot Distribution

A chart showing visit distribution by AI bot. Immediately identify which bots crawl your site most and which important bots are absent.

Referral Sources

Referral traffic breakdown by AI source, with time evolution. Compare volumes from ChatGPT, Claude, Perplexity, and others.

Mention Trends

Your mention evolution in LLM responses over 30, 60, and 90 days, decomposed by sentiment and model.

How to Install Tracking

Tracking Script

A lightweight JavaScript snippet is added to your site, similar to a standard analytics tracking code. This script:

• Does not impact site performance (async loading, under 2 KB)
• Automatically detects AI bots server-side via HTTP headers
• Captures AI referral visits client-side
• Natively respects GDPR (no cookies for bot tracking)

API Key

Each site gets a unique API key for tracking data identification, auto-generated during setup and regenerable anytime for security.

Combining Tracking with Audit Results for Complete GEO Picture

The true power of AI tracking emerges when combined with audit results:

• Correlate crawl and mentions: verify if bots crawling your site lead to LLM mentions. Active crawl with low mentions signals content needing optimization.
• Validate optimizations: after technical improvements (SSR, structured data, llms.txt), tracking shows whether AI bots crawl more and mentions increase.
• Measure GEO ROI: by linking referral traffic, mentions, and visibility score, calculate your AEO return on investment.
• Feed the GEO checklist: tracking data enriches checklist results, showing the real impact of technical points on crawl and mentions.

Use Cases for Agencies

Agencies using the agent dashboard benefit particularly from AI tracking:

Client Value Reporting

Tracking provides tangible metrics: "Your site received 1,247 AI bot visits this month, including 342 from GPTBot. Your mentions increased 18% and AI referral traffic generated 89 qualified visits."

Proactive Problem Detection

A sudden drop in bot visits may indicate technical issues (misconfigured robots.txt, slow server, 5xx errors). Tracking lets agencies detect and resolve problems before they impact mentions.

Cross-Client Benchmarking

Compare tracking metrics across clients to identify best practices: which clients attract the most AI bots? What technical configurations generate the most referral traffic?

Service Upselling

Tracking data reveals natural upsell opportunities: a client with high crawl but low mentions needs content optimization. A client with hallucinated URLs needs a redirect strategy. Explore optimized audit prompts and showcase pages for GEO backlinks to enrich your offering.

Conclusion

AI Labs Audit's complete AI tracking is far more than a simple bot counter. It is an integrated system connecting the four dimensions of AI visibility: crawl, mentions, referral traffic, and hallucinations. By combining this data with GEO audits, the 26-point checklist, and competitive analysis, you get the most comprehensive view possible of your AI ecosystem presence — and the tools to improve it.