Control token (no crawler) · Apple

Applebot-Extended

Applebot-Extended is Apple's robots.txt control token (not a crawler). It is set in robots.txt only; no request carries it.

Operator
Apple
Purpose
Control token (no crawler)
robots.txt
Set here only (no requests)
Last checked

Why there is no user agent

Applebot-Extended is a name you use in robots.txt only. It never appears in your logs, because no crawler sends it.

robots.txt rules

To block it everywhere:

User-agent: Applebot-Extended
Disallow: /

To allow it explicitly, for example when a broader rule blocks other agents:

User-agent: Applebot-Extended
Allow: /

What blocking it changes

Apple says Applebot-Extended does not crawl webpages. Disallowing it opts your content out of training Apple’s generative foundation models; pages that disallow it can still be included in search results, and Apple says its rules are not considered in ranking.

  • It works like Google-Extended: a training preference applied to what Applebot has already crawled.

How to verify a request is genuine

There is nothing to verify: Applebot-Extended never appears in logs. The requests come from Applebot.

Other Apple agents

Sources

Apple's documentation for Applebot-Extended, read on 15 Oct 2026. Operators change these pages without notice; check before relying on a detail.

Check how your site treats Applebot-Extended

The AI crawler access check reads your robots.txt and reports the rule that applies to this token.

Run the free check All AI crawlers