Google · control token
Google-Extended: robots.txt token and blocking it
Everything on this page is taken from Google's own documentation, quoted and linked, and was checked on 4 October 2026. Where the documentation is silent the page says so instead of filling the gap.
What it is
Operator: Google. Kind, as listed here: control token.
“Google-Extended is a standalone product token that web publishers can use to manage whether content Google crawls from their sites may be used for training future generations of Gemini models”
Source: Google common crawlers, checked 4 October 2026.
User-agent string: none published
Google says: “Google-Extended doesn't have a separate HTTP request user agent string. Crawling is done with existing Google user agent strings; the robots.txt user-agent token is used in a control capacity.”
Source: Google common crawlers. The robots.txt token to match is Google-Extended.
Does it obey robots.txt?
The Google page does not state it for this token in so many words. It is a robots.txt token, not a crawler that makes requests.
Does it affect search?
“Google-Extended does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search.”
Source: Google common crawlers, checked 4 October 2026.
What else Google says
“Google-Extended doesn't have a separate HTTP request user agent string. Crawling is done with existing Google user agent strings; the robots.txt user-agent token is used in a control capacity.”
Source: Google common crawlers, checked 4 October 2026.
“and for grounding (providing content from the Google Search index to the model at prompt time to improve factuality and relevancy)”
Source: Google common crawlers, checked 4 October 2026.
robots.txt snippets
Two snippets that show the syntax for this token. They are examples, not advice: whether to allow or refuse Google-Extended is your decision, and the effects above are the vendor's description of them.
Allow Google-Extended
User-agent: Google-Extended Allow: /
Disallow Google-Extended
User-agent: Google-Extended Disallow: /
How to verify requests
Google gives no IP-range file or DNS method for this token on the page we checked.
Questions
What is Google-Extended?
Google describes Google-Extended like this: “Google-Extended is a standalone product token that web publishers can use to manage whether content Google crawls from their sites may be used for training future generations of Gemini models”
Does Google-Extended obey robots.txt?
Google-Extended is a robots.txt token only, so there is no crawler to obey the file: a Disallow for it is a signal Google reads.
How do I block Google-Extended in robots.txt?
Add a group to robots.txt with the line “User-agent: Google-Extended” followed by “Disallow: /”. That is an example of the syntax, not a recommendation. On search, Google says: “Google-Extended does not impact a site's inclusion in Google Search nor is it used as a ranking signal in Google Search.”
Also see the robots.txt tester for AI crawlers and the other entries in the AI crawler reference.
Last reviewed . Maintained by Cite Files — corrections to [email protected].