# Scaling Autonomous Site Reliability Engineering: Architecture, Orchestration, and Validation for a 90,000+ Server Fleet

DevFeed: [Scaling Autonomous Site Reliability Engineering: Architecture, Orchestration, and Validation for a 90,000+ Server Fleet](<https://devfeed.tech/articles/scaling-autonomous-site-reliability-engineering-architecture-orchestration-and-validation-for-a-90-000-server-fleet-19941.md>)

Original publisher: [Read original article](<https://www.digitalocean.com/blog/scaling-autonomous-site-reliability>)

Author: Najmus Saqib

Published: 2026-03-13T15:49:48Z

Content type: article

Language: en

Sources: [DigitalOcean](<https://devfeed.tech/sources/digitalocean.md>)

Topics: [SRE](<https://devfeed.tech/topics/sre.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [web applications](<https://devfeed.tech/topics/web-applications.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [PHP](<https://devfeed.tech/topics/php.md>), [Debian](<https://devfeed.tech/topics/debian.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [article](<https://devfeed.tech/tags/article.md>), [debian](<https://devfeed.tech/tags/debian.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [hosting](<https://devfeed.tech/tags/hosting.md>), [llms](<https://devfeed.tech/tags/llms.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [php](<https://devfeed.tech/tags/php.md>), [sre](<https://devfeed.tech/tags/sre.md>), [web-applications](<https://devfeed.tech/tags/web-applications.md>)

## AI overview

The article describes how Cloudways developed an AI SRE agent to help investigate and troubleshoot incidents affecting web applications. It discusses the monitoring layer, control plane, Insight Generation Engine, and the agent's use of Cloudways-specific Debian customizations.

## Source excerpt

As Cloudways scaled from a bootstrapped startup to a leading managed PHP hosting service, one of the biggest challenges we encountered was the growing support load. Managing a fleet of over 90,000 servers and half a million applications means thousands of support requests, requiring a team of hundreds of human support agents. The rise of LLMs and AI agents provided an ideal opportunity to rethink our support operations. Early on, we recognized that an AI-based SRE agent could significantly reduce the burden on our support teams. At Cloudways, we deeply care about our customers' applications and websites because they are the backbone of their businesses and livelihoods. Every minute of downtime matters, and our priority has always been to ensure their apps come back online as quickly as possible. An AI SRE agent helps customers to receive timely, in-depth investigation and troubleshooting for their web applications delivering faster diagnosis and quicker resolution. Cloudways Copilot, an AI-powered Site Reliability Engineer in its current state is a result of over a year of constant efforts to achieve these goals. It has features like Insights and SmartFix which provide users access to a detailed diagnosis and resolution steps for web apps incidents. These AI-powered insights are significantly faster and more consistent than those provided by a human agent. View Wistia video How does CW Copilot work? The monitoring layer continuously observes each user machine for Webstack issues and excessive. When an anomaly is detected, it triggers an alert and forwards it to the control plane. The control plane then routes the alert to the Insight Generation Engine, which consists of following components: AI SRE Agent The effectiveness of an AI agent depends heavily on the context it is provided. The agent is made aware of the customizations done by Cloudways on top of Debian so that it can work in an optimized way. It includes details like: File structure details (e.g., where co