# Cloudflare adds controls to allow search indexing while disallowing AI training

DevFeed: [Cloudflare adds controls to allow search indexing while disallowing AI training](<https://devfeed.tech/articles/have-it-both-ways-stay-discoverable-in-search-while-disallowing-ai-training-26580.md>)

Original publisher: [Read original article](<https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/>)

Author: Bryan Becker

Published: 2026-09-15T13:00:00Z

Content type: release

Language: en

Sources: [Cloudflare Blog](<https://devfeed.tech/sources/cloudflare-blog.md>)

Topics: [Cloudflare](<https://devfeed.tech/topics/cloudflare.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Crawler](<https://devfeed.tech/topics/crawler.md>), [Google](<https://devfeed.tech/topics/google.md>), [Microsoft](<https://devfeed.tech/topics/microsoft.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-bots](<https://devfeed.tech/tags/ai-bots.md>), [blocking](<https://devfeed.tech/tags/blocking.md>), [bot-management](<https://devfeed.tech/tags/bot-management.md>), [bots](<https://devfeed.tech/tags/bots.md>), [cloudflare](<https://devfeed.tech/tags/cloudflare.md>), [content](<https://devfeed.tech/tags/content.md>), [google](<https://devfeed.tech/tags/google.md>), [internet](<https://devfeed.tech/tags/internet.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [network-services](<https://devfeed.tech/tags/network-services.md>), [product-news](<https://devfeed.tech/tags/product-news.md>), [search](<https://devfeed.tech/tags/search.md>), [security](<https://devfeed.tech/tags/security.md>)

## AI overview

Cloudflare announces a Disallow AI Training setting that lets website owners remain indexed in search while refusing AI training by mixed-use crawlers. Apple, Google, and Microsoft honor or have committed to honor the setting.

## Source excerpt

Cloudflare is giving site owners a way to stay discoverable while disallowing AI training. New controls and an Accountable designation establish a shared model with Apple, Google, and Microsoft.