# Can LLMs replace on call SREs today?

DevFeed: [Can LLMs replace on call SREs today?](<https://devfeed.tech/articles/can-llms-replace-on-call-sres-today-5391.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/llm-observability-challenge>)

Author: Lionel Palacin; Al Brown

Published: 2025-08-14T00:00:00Z

Content type: article

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [incident](<https://devfeed.tech/topics/incident.md>)

Tags: [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [llms](<https://devfeed.tech/tags/llms.md>), [observability](<https://devfeed.tech/tags/observability.md>), [on-call](<https://devfeed.tech/tags/on-call.md>), [opentelemetry](<https://devfeed.tech/tags/opentelemetry.md>), [root-cause-analysis](<https://devfeed.tech/tags/root-cause-analysis.md>), [sre](<https://devfeed.tech/tags/sre.md>)

## AI overview

ClickHouse evaluates whether LLMs can autonomously perform root-cause analysis for production anomalies. Its result is that autonomous RCA is not yet reliable; LLMs are better used to assist engineers during investigations.

## Source excerpt

We often hear that LLMs will soon replace SREs. We wanted to test that claim, so we ran an experiment. Read the blog to see what we found.