Google-Extended
Google-Extended isn't a separate crawler: it's a switch you set in robots.txt to tell Google whether it can use your content to train future generations of its Gemini models. Blocking it doesn't remove you from Google Search or affect your ranking, but it does reduce what Gemini knows about your business.
- User-agent
Google-Extended- Does it respect robots.txt?
- Yes
- Official documentation
- https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers
How to allow it in your robots.txt
User-agent: Google-Extended
Allow: /How to block it (not recommended)
User-agent: Google-Extended
Disallow: /Frequently asked questions
Should I block Google-Extended?
For most businesses, no. Allowing it lets Gemini models learn from your content, which increases the chances Gemini knows about and mentions your brand. Blocking it doesn't improve your SEO at all.
Does blocking Google-Extended affect my Google ranking?
No. Google confirms Google-Extended has no influence on search inclusion or ranking. It only controls whether your content is used to train Gemini models.
Will I see Google-Extended in my logs?
No, because it doesn't crawl by itself: the crawling is done by Googlebot and other Google bots. Google-Extended is just the name you use in robots.txt to grant or remove training permission.