# Network Services

Published articles for Network Services.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Cloudflare adds controls to allow search indexing while disallowing AI training

DevFeed: [Cloudflare adds controls to allow search indexing while disallowing AI training](<https://devfeed.tech/articles/have-it-both-ways-stay-discoverable-in-search-while-disallowing-ai-training-26580.md>)

Original publisher: [Read original article](<https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/>)

Author: Bryan Becker

Published: 2026-09-15T13:00:00Z

Content type: release

Language: en

Sources: [Cloudflare Blog](<https://devfeed.tech/sources/cloudflare-blog.md>)

Topics: [Cloudflare](<https://devfeed.tech/topics/cloudflare.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Crawler](<https://devfeed.tech/topics/crawler.md>), [Google](<https://devfeed.tech/topics/google.md>), [Microsoft](<https://devfeed.tech/topics/microsoft.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-bots](<https://devfeed.tech/tags/ai-bots.md>), [blocking](<https://devfeed.tech/tags/blocking.md>), [bot-management](<https://devfeed.tech/tags/bot-management.md>), [bots](<https://devfeed.tech/tags/bots.md>), [cloudflare](<https://devfeed.tech/tags/cloudflare.md>), [content](<https://devfeed.tech/tags/content.md>), [google](<https://devfeed.tech/tags/google.md>), [internet](<https://devfeed.tech/tags/internet.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [network-services](<https://devfeed.tech/tags/network-services.md>), [product-news](<https://devfeed.tech/tags/product-news.md>), [search](<https://devfeed.tech/tags/search.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

Cloudflare announces a Disallow AI Training setting that lets website owners remain indexed in search while refusing AI training by mixed-use crawlers. Apple, Google, and Microsoft honor or have committed to honor the setting.

### Source excerpt

Cloudflare is giving site owners a way to stay discoverable while disallowing AI training. New controls and an Accountable designation establish a shared model with Apple, Google, and Microsoft.

## Say it once: Introducing Bot Preference Sync

DevFeed: [Say it once: Introducing Bot Preference Sync](<https://devfeed.tech/articles/say-it-once-introducing-bot-preference-sync-107.md>)

Original publisher: [Read original article](<https://blog.cloudflare.com/bot-preference-sync/>)

Author: Jin-Hee Lee

Published: 2026-08-21T23:19:57Z

Content type: article

Language: en

Sources: [Cloudflare Blog](<https://devfeed.tech/sources/cloudflare-blog.md>)

Topics: [AI Bots](<https://devfeed.tech/topics/ai-bots.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-bots](<https://devfeed.tech/tags/ai-bots.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [bot-management](<https://devfeed.tech/tags/bot-management.md>), [bots](<https://devfeed.tech/tags/bots.md>), [cloudflare](<https://devfeed.tech/tags/cloudflare.md>), [network-services](<https://devfeed.tech/tags/network-services.md>), [product-news](<https://devfeed.tech/tags/product-news.md>), [robots](<https://devfeed.tech/tags/robots.md>), [search](<https://devfeed.tech/tags/search.md>), [sync](<https://devfeed.tech/tags/sync.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

Cloudflare introduces Bot Preference Sync, which updates robots.txt preferences to match configured AI bot policies for Search, Agent, and Training traffic.

### Source excerpt

Cloudflare's new Bot Preference Sync automatically aligns your robots.txt file with your AI bot policies for Search, Agent, and Training. Easily manage which bots access your content without maintaining static files.