Control token (no crawler) · Google

Google-Extended

Google-Extended is Google's robots.txt control token (not a crawler). It is set in robots.txt only; no request carries it.

Operator
Google
Purpose
Control token (no crawler)
robots.txt
Set here only (no requests)
Last checked

Why there is no user agent

Google-Extended is a name you use in robots.txt only. It never appears in your logs, because no crawler sends it.

robots.txt rules

To block it everywhere:

User-agent: Google-Extended
Disallow: /

To allow it explicitly, for example when a broader rule blocks other agents:

User-agent: Google-Extended
Allow: /

What blocking it changes

Google-Extended is a robots.txt token, not a crawler. Disallowing it tells Google not to use content Googlebot has crawled for training future Gemini models or for grounding in Gemini Apps and Vertex AI. Google says it does not affect a site’s inclusion in Google Search and is not a ranking signal.

  • AI Overviews and AI Mode follow the normal Search controls (noindex, nosnippet, max-snippet), not Google-Extended.

How to verify a request is genuine

There is nothing to verify: Google-Extended never appears in logs. The requests come from Googlebot.

Other Google agents

Sources

Google's documentation for Google-Extended, read on 15 Oct 2026. Operators change these pages without notice; check before relying on a detail. Definition: Google-Extended in our glossary.

Check how your site treats Google-Extended

The AI crawler access check reads your robots.txt and reports the rule that applies to this token.

Run the free check All AI crawlers