# AI Bots Published articles for AI Bots. This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles. ## Cloudflare adds controls to allow search indexing while disallowing AI training DevFeed: [Cloudflare adds controls to allow search indexing while disallowing AI training]() Original publisher: [Read original article]() Author: Bryan Becker Published: 2026-09-15T13:00:00Z Content type: release Language: en Sources: [Cloudflare Blog]() Topics: [Cloudflare](), [Artificial Intelligence](), [Crawler](), [Google](), [Microsoft]() Tags: [ai](), [ai-bots](), [blocking](), [bot-management](), [bots](), [cloudflare](), [content](), [google](), [internet](), [microsoft](), [network-services](), [product-news](), [search](), [security]() ### AI overview Cloudflare announces a Disallow AI Training setting that lets website owners remain indexed in search while refusing AI training by mixed-use crawlers. Apple, Google, and Microsoft honor or have committed to honor the setting. ### Source excerpt Cloudflare is giving site owners a way to stay discoverable while disallowing AI training. New controls and an Accountable designation establish a shared model with Apple, Google, and Microsoft. ## BotBase for Operators: A clearer path to joining Cloudflare's directory of bots and agents DevFeed: [BotBase for Operators: A clearer path to joining Cloudflare's directory of bots and agents]() Original publisher: [Read original article]() Author: Julian Laxman Published: 2026-08-28T12:59:44Z Content type: release Language: en Sources: [Cloudflare Blog]() Topics: [AI Bots]() Tags: [agents](), [ai-bots](), [application-security](), [bot-management](), [bots](), [cloudflare](), [content](), [model](), [update]() ### AI overview Cloudflare launched BotBase for Operators, adding a dashboard area where bot operators can browse the directory, submit bots, and track submission history. The update also provides submission-status visibility, editing, and a behavior model for declaring content use. ### Source excerpt Bot operators now have a home in the Cloudflare dashboard to manage submissions. This update adds submission status tracking, submission editing, and a behavior model so operators can accurately declare how their bots use content. ## Say it once: Introducing Bot Preference Sync DevFeed: [Say it once: Introducing Bot Preference Sync]() Original publisher: [Read original article]() Author: Jin-Hee Lee Published: 2026-08-21T23:19:57Z Content type: article Language: en Sources: [Cloudflare Blog]() Topics: [AI Bots]() Tags: [ai](), [ai-bots](), [ai-models](), [ai-training](), [bot-management](), [bots](), [cloudflare](), [network-services](), [product-news](), [robots](), [search](), [sync](), [training]() ### AI overview Cloudflare introduces Bot Preference Sync, which updates robots.txt preferences to match configured AI bot policies for Search, Agent, and Training traffic. ### Source excerpt Cloudflare's new Bot Preference Sync automatically aligns your robots.txt file with your AI bot policies for Search, Agent, and Training. Easily manage which bots access your content without maintaining static files. ## For your business to thrive in the agentic AI era, treat accessibility as foundational to your AI strategy DevFeed: [For your business to thrive in the agentic AI era, treat accessibility as foundational to your AI strategy]() Original publisher: [Read original article]() Author: Preety Kumar Published: 2026-07-29T10:51:43Z Content type: article Language: en Sources: [Deque]() Topics: [Accessibility](), [AI Strategy](), [Artificial Intelligence](), [agentic browsing](), [AI Bots](), [aria](), [HTML](), [Web]() Tags: [accessibility](), [accessibility-best-practices](), [agentic-ai](), [agentic-browsing](), [ai](), [ai-bots](), [ai-strategy](), [article](), [digital-accessibility](), [html](), [web](), [web-accessibility](), [web-content-accessibility-guidelines]() ### AI overview The article argues that digital accessibility should be foundational to AI strategy because AI agents increasingly browse, click, complete forms, and interpret web pages through structures also used by assistive technologies. It highlights semantic HTML, ARIA, WCAG conformance, and a sound accessibility tree as important for both human access and agentic navigation, while warning that accessibility failures remain widespread. ### Source excerpt You need to build accessibility into how AI writes code from the first prompt, not fix it after the fact. And because the disability community has been perfecting human-computer interaction for different input and output modalities for decades, their expertise isn't just morally important; it's technically essential for building robust, reliable AI that actually works. The post For your business to thrive in the agentic AI era, treat accessibility as foundational to your AI strategy appeared first on Deque. ## Your robots.txt Says Yes. Your Firewall Says 403. DevFeed: [Your robots.txt Says Yes. Your Firewall Says 403.]() Original publisher: [Read original article]() Author: Brent Leekley Published: 2026-06-11T00:00:00Z Content type: article Language: en Sources: [brent.leekley.me blog]() Topics: [Cloudflare](), [AI Bots](), [AI search](), [Crawler](), [Firewall]() Tags: [403](), [aeo](), [ai-bots](), [ai-crawl-control](), [ai-crawlers](), [ai-search](), [ai-visibility](), [blocking](), [bot-management](), [chatgpt-user](), [cloudflare](), [firewall](), [gptbot](), [oai-searchbot](), [perplexity](), [robots](), [robots-txt]() ### AI overview A field note explains how a Cloudflare AI-bot blocking setting returned 403 responses to all AI agents even though the site's robots.txt allowed AI search and blocked training crawlers. It distinguishes training crawlers, search indexers, and user-triggered fetchers, and recommends auditing enforcement at the firewall layer. ### Source excerpt A client's robots.txt welcomed AI search and blocked training crawlers, but Cloudflare's blunt AI-bot toggle was returning 403 to every AI agent at the edge. How the block was found, the AI Crawl Control fix, and why you should audit enforcement, not intent. ## Sandboxed AI bots: give capabilities, not credentials DevFeed: [Sandboxed AI bots: give capabilities, not credentials]() Original publisher: [Read original article]() Author: Alex Petric Published: 2026-04-23T00:00:00Z Content type: tutorial Language: en Sources: [Windmill Blog]() Topics: [Security](), [Discord](), [Discord bot](), [stripe](), [implementation](), [WebSocket](), [HashiCorp Vault]() Tags: [agent](), [ai](), [ai-bots](), [ai-discord-websocket-triggers](), [api-keys](), [credentials](), [discord](), [secret-storage](), [secrets](), [security](), [ssh](), [stripe](), [websocket](), [websocket-triggers]() ### AI overview This tutorial shows how to build a Discord bot that answers billing questions through Stripe while keeping API keys hidden from an AI agent. Windmill tools retrieve credentials at runtime from encrypted resource storage, and the agent receives only tool capabilities. The sandbox also provides process, filesystem, CPU, memory, and optional network isolation. ### Source excerpt How do I build an AI Discord bot that accesses Stripe without leaking API keys? Use Windmill sandboxed tools to give the AI capabilities, not credentials. ## Is it OK to let your children post selfies online? DevFeed: [Is it OK to let your children post selfies online?]() Original publisher: [Read original article]() Author: Phil Muncaster Published: 2026-02-17T10:00:00Z Content type: article Language: en Sources: [WeLiveSecurity]() Topics: [online privacy](), [AI Bots](), [Large Language Model]() Tags: [ai](), [ai-bots](), [identity-theft](), [kids-online](), [large-language-models-llms](), [tech](), [technology]() ### AI overview The article advises parents on helping children develop a healthy relationship with technology while considering the risks of posting selfies on social media. It explains how digital permanence, reposting, AI bots scraping content to train large language models, predators, extortion, cyberbullying, and exposed personal information can threaten children's privacy and safety. ### Source excerpt When it comes to our children's digital lives, prohibition rarely works. It's our responsibility to help them build a healthy relationship with tech. ## Thwarting AI Bots with Edge Content Rewriting DevFeed: [Thwarting AI Bots with Edge Content Rewriting]() Original publisher: [Read original article]() Author: Matt Butcher Published: 2025-10-13T12:00:00Z Content type: article Language: en Sources: [Fermyon - Experience the next wave of cloud computing.]() Topics: [AI Bots](), [Edge](), [Artificial Intelligence]() Tags: [ai](), [ai-bots](), [bots](), [edge]() ### AI overview The article describes using bot detection and dynamic content rewriting at the edge to thwart bots that scrape prices or use an organization's IP for training. ### Source excerpt Use bot detection and dynamic content rewriting to thwart bots that are scraping your prices or using your IP for training