FR
EN
ES
DE
Google-Extended is Google's crawler specifically dedicated to AI model training (Gemini). Distinct from classic Googlebot, it can be blocked separately via robots.txt.
What is Google-Extended?
Google-Extended is a specific Google User-Agent, distinct from the classic Googlebot used for Search indexing. Its role is to collect data for training Google's AI models, particularly Gemini (formerly Bard). This separation allows site publishers to independently control access to their content for classic search and for AI.
Difference from Googlebot
- Googlebot: Crawls for Google Search indexing (classic results)
- Google-Extended: Crawls for Google AI model training (Gemini, AI Overviews)
Blocking Google-Extended does not affect your classic Google Search ranking.
robots.txt Configuration
User-agent: Google-Extended
Allow: / # Allow for AI visibility
# or
Disallow: / # Block AI trainingRecommended Strategy
To maximize your visibility on Gemini and AI Overviews, it is recommended to allow Google-Extended. Combined with allowing GPTBot, ClaudeBot and PerplexityBot, this constitutes a comprehensive GEO strategy for all major AI models.