Google-CloudVertexBot
Google-CloudVertexBot is a Google crawler that operates on behalf of businesses building AI agents or internal search systems using Google Cloud Vertex AI. Unlike the standard Googlebot, this crawler has no effect on Google Search rankings — its purpose is to index content for AI-powered enterprise applications. As more organizations deploy Vertex AI-based agents, keeping your content accessible through this bot may open an additional visibility channel beyond traditional search.
- User-agent
Google-CloudVertexBotMozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/144.0.7559.132 Mobile Safari/537.36 (compatible; Google-CloudVertexBot; +https://cloud.google.com/enterprise-search)- Does it respect robots.txt?
- Yes
- Official documentation
- https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
How to allow it in your robots.txt
User-agent: Google-CloudVertexBot
Allow: /How to block it (not recommended)
User-agent: Google-CloudVertexBot
Disallow: /Frequently asked questions
Should I block Google-CloudVertexBot?
For most businesses, there is no reason to block it. This bot crawls your site on behalf of companies building AI systems with Google Cloud, not for Google's own search index. Blocking it won't affect your Google Search rankings, but it may reduce your presence in Vertex AI-based enterprise agents and search applications.
Does it affect my visibility on Google Search or ChatGPT?
No, it has no effect on either Google Search or ChatGPT. It is specific to applications built with Google Cloud Vertex AI, such as AI agents or internal search tools that businesses and institutions deploy for their own users. If your content is accessible, it may surface in those systems when someone queries them.
How do I know if Google-CloudVertexBot is visiting my site?
Search for 'Google-CloudVertexBot' in your server's access logs or in your CDN dashboard — for example, Cloudflare. Every visit will be recorded with that name in the user-agent field.