Skip to content
Contact

WritingGuide

Which search index feeds ChatGPT, Gemini, Copilot, Claude?

By · Published · Updated

Sources checked on

There is no single answer: each AI product gets its search results from a different place, and most companies do not say so plainly. The table below separates what is official, what comes from secondary sources, and what we could not verify, based on documents we read on 20 October 2026.

Which search index does each AI product use?

ProductIndexStatusBasis
Google AI Overviews and AI ModeGoogle SearchOfficialGoogle: to be shown as a supporting link, a page must be indexed and eligible to be shown in Google Search with a snippet; there are no additional technical requirements.
Gemini (app and API)Google Search indexOfficialGoogle's crawler documentation describes grounding in Gemini Apps as providing content from the Google Search index to the model at prompt time. The Gemini API documentation also describes grounding with Google Search.
Microsoft 365 Copilot and Copilot ChatBing search serviceOfficialMicrosoft Learn (a Microsoft 365 document): with web search on, Copilot generates a search query from the user's prompt and sends it to the Bing search service.
ChatGPT searchNot in the documentationPartly secondaryOpenAI says OAI-SearchBot is used to surface sites in ChatGPT's search features. We found no sentence naming an outside index. Secondary sources from 2024 name Bing.
PerplexityOwn bot; no other source verifiedPartly officialPerplexity: PerplexityBot is designed to surface and link websites in Perplexity search results. We found nothing on whether it also uses another provider's results.
ClaudeBrave Search and Anthropic's own botPartly officialAnthropic's subprocessor list names Brave Search for "Web Search". Claude-SearchBot also exists "to improve search result quality". Anthropic does not say what share of results comes from where.

The table is a snapshot; products change. Details for each row follow.

What do Google's AI Overviews and Gemini use?

Both use Google's own index. Google's AI features documentation (last updated 10 December 2025) says that to be shown as a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to be shown in Google Search with a snippet, and that there are no other technical requirements. So there is no separate registration or file for AI summaries; being in the index is the condition, and being in the index is not guaranteed.

For Gemini, Google's crawler documentation (last updated 15 October 2026) explains the Google-Extended control by tying "grounding", meaning providing content from the Google Search index to the model at prompt time, to Gemini Apps and to Grounding with Google Search on Vertex AI. The same page says Google-Extended does not affect a site's inclusion in Google Search and is not a ranking signal.

Does ChatGPT take its search results from Bing?

We found no sentence in OpenAI's documentation that says so. What we know:

  • OpenAI's crawler page says OAI-SearchBot is used to surface websites in search results in ChatGPT's search features. Sites opted out of OAI-SearchBot will not be shown in ChatGPT search answers, though they can still appear as navigational links. A robots.txt change can take about 24 hours to reach their systems.
  • The developer documentation for ChatGPT's web search tool does not name an index provider either.
  • OpenAI's ChatGPT search help page and its announcement post were not reachable for us (the server returned 403), so we could not verify what they say.
  • Secondary sources: InfoQ (5 November 2024) writes that internet searches in ChatGPT search are performed by third-party engines, including Bing, and that OpenAI partnered directly with some publishers. Yoast (12 November 2024, updated 10 December 2024) says it uses Bing's index and other sources.

These are almost two years old and secondary. We could not confirm with OpenAI that they still hold. The safe conclusion: allow OAI-SearchBot and make sure your pages are also in Bing's index, but there is no official document saying that being in Bing gets you into ChatGPT.

What does Perplexity use?

Perplexity's bot page says PerplexityBot "is designed to surface and link websites in search results on Perplexity" and is not used to collect content for model training. Perplexity-User is a separate identity that can visit a page when a user asks a question; the page says it generally ignores robots.txt rules because the user requested the fetch. Whether Perplexity also uses another search provider's results is not stated in the documents we read: not verified. We could not reach Perplexity's blog post (perplexity.ai/hub/blog/introducing-the-perplexity-search-api), its FAQ page (perplexity.ai/hub/faq/how-does-perplexity-work) or the research.perplexity.ai article from our environment (403), so we did not verify what they say. A reviewer could open the perplexity.ai/hub/blog index separately, but we did not look in it for this topic.

Anthropic's support page lists three bots: ClaudeBot (collects content that may be used for training), Claude-User (visits sites when a user asks Claude a question) and Claude-SearchBot (navigates the web to improve search result quality). It says that disabling Claude-SearchBot prevents Anthropic's system from indexing your content for search, which may reduce your visibility in search results.

For Brave there is an official trace. Anthropic's subprocessor list (its Trust Center) shows "Brave Search" for the function "Web Search", for all products, based in the United States. We opened the list in a browser on 20 October 2026; the page text does not arrive in the first HTML and is loaded by JavaScript. The list shows that Brave processes data for web search. Anthropic does not say that all of Claude's search results come from Brave's index, or what exactly Claude-SearchBot does in this.

Secondary sources are older but point the same way: Brave Search was added to the list on 19 March 2025 (Simon Willison, 21 March 2025), a parameter called "BraveSearchParams" was seen in Claude's search function, and one search's citations matched Brave's results exactly. TechCrunch (21 March 2025) wrote that Anthropic "appears" to use Brave.

What does this mean for your site?

There is no single index, so there is no single check. Start with what is documented:

  1. Be in Google's index. It is the shared condition for AI Overviews, AI Mode and Gemini. Watch the status in Google Search Console.
  2. Be in Bing's index too. It is the documented route for Microsoft 365 Copilot, and secondary sources name Bing for ChatGPT. Watch the status in Bing Webmaster Tools.
  3. Allow the search bots in robots.txt. The ones named in this article: Googlebot, Bingbot, OAI-SearchBot, PerplexityBot, Claude-SearchBot. Our article on which to allow and why: Robots.txt for AI bots.
  4. Check that your CDN or firewall does not cut the bot. A bot you allowed in robots.txt can still be stopped at the door: Is Cloudflare blocking AI bots you allowed in robots.txt?
  5. Verify real bots in your log. A name in the log can be written by anyone: AI bots in your server log.

Ruescan is Rueseo's site scanner; one of its 275 signals looks at the permission robots.txt gives AI bots. Of the 30 Turkish sites we measured on 19 October 2026, 4 blocked at least one of the search bots that collect sources for AI answers in robots.txt (details and limits of the measurement).

Frequently asked questions

Do I have to register with Bing to appear in ChatGPT?

We found no official document that says so. According to OpenAI's documentation, what you need is to allow OAI-SearchBot and not block it. Bing's role rests on secondary sources from 2024.

If I block Google-Extended, do I drop out of AI Overviews?

According to Google's documentation, Google-Extended governs the training of Gemini models and grounding in Gemini Apps and on Vertex AI; it does not affect a site's place in Google Search and is not a ranking signal. The conditions for appearing in AI Overviews are written above: being indexed and eligible to show a snippet. We could not verify Google-Extended's effect on AI Overviews from the documentation.

Is there a separate registration form for each AI product?

Not in the documents we read. Google says there are no additional technical requirements for its AI features; we found no registration form in the other companies' documentation.

How often does this table change?

We do not know. Products change quickly, which is why the page shows a source-check date, and we update it when something changes.

What about other products, such as Mistral?

This article only looks at products from Google, Microsoft, OpenAI, Perplexity and Anthropic. We did not examine the others.

Sources

All read on 20 October 2026.

  • Google Search Central, AI features and your website (last updated 10 December 2025): developers.google.com
  • Google Search Central, Google's common crawlers, Google-Extended section (last updated 15 October 2026): developers.google.com
  • Google AI for Developers, Grounding with Google Search (last updated 13 October 2026): ai.google.dev
  • Microsoft Learn, Data, privacy, and security for web search in Microsoft Copilot and Microsoft Copilot Chat (Microsoft 365) (18 August 2026): learn.microsoft.com
  • OpenAI, Overview of OpenAI crawlers: developers.openai.com
  • OpenAI, web search tool developer documentation: developers.openai.com
  • Perplexity, crawlers and user agents: docs.perplexity.ai
  • Anthropic, Does Anthropic crawl data from the web, and how can site owners block the crawler: support.claude.com
  • Anthropic, Trust Center, subprocessor list (page loaded in a browser): trust.anthropic.com
  • InfoQ, OpenAI Releases ChatGPT Search Feature (5 November 2024, secondary): infoq.com
  • Yoast, What is ChatGPT Search (and how does it use Bing data) (12 November 2024, secondary): yoast.com
  • TechCrunch, Anthropic appears to be using Brave to power web search for its Claude chatbot (21 March 2025, secondary): techcrunch.com
  • Simon Willison, Anthropic Trust Center: Brave Search added as a subprocessor (21 March 2025, secondary): simonwillison.net
  • Rueseo, homepage measurement of 30 Turkish sites (19 October 2026): Are Turkish websites ready for AI?

Want to talk about this for your brand?

Write about your project and what you want to do. The message goes straight to Rues.

Open the contact form