GPTBot
GPTBot is OpenAI's training crawler — OpenAI is the company behind ChatGPT. It visits public websites and stores their content so future AI models can learn from it. If your site is in that data, ChatGPT is more likely to know your business and mention it when someone asks about what you offer.
- User-agent
GPTBotMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.3; +https://openai.com/gptbot- Does it respect robots.txt?
- Yes
- Official documentation
- https://developers.openai.com/api/docs/bots
How to allow it in your robots.txt
User-agent: GPTBot
Allow: /How to block it (not recommended)
User-agent: GPTBot
Disallow: /Frequently asked questions
Should I block GPTBot?
For a business that wants customers, no. Blocking it means OpenAI's models don't learn from your content, so your business is less likely to show up when someone asks ChatGPT about products or services like yours.
Does GPTBot affect my visibility in ChatGPT?
Yes, indirectly. GPTBot feeds model training. If your site is well written and accessible to GPTBot, ChatGPT is more likely to know your brand and mention it in its answers.
How do I know if GPTBot visits my site?
Search for "GPTBot" in your server logs or your hosting/CDN dashboard, e.g. Cloudflare. Every visit is recorded with that name in the user-agent field.