# Using Evaluation Frameworks with Agent Observability

DevFeed: [Using Evaluation Frameworks with Agent Observability](<https://devfeed.tech/articles/using-evaluation-frameworks-with-agent-observability-2318.md>)

Original publisher: [Read original article](<https://www.datadoghq.com/blog/using-evaluation-frameworks-with-agent-observability/>)

Author: Jennifer Mickel; Eddie Cai

Published: 2026-06-22T00:00:00Z

Content type: article

Language: en

Sources: [Datadog | The Monitor blog](<https://devfeed.tech/sources/datadog-the-monitor-blog.md>)

Topics: [agent observability](<https://devfeed.tech/topics/agent-observability.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Pydantic](<https://devfeed.tech/topics/pydantic.md>), [experiments](<https://devfeed.tech/topics/experiments.md>), [Traces](<https://devfeed.tech/topics/traces.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [agent-observability](<https://devfeed.tech/tags/agent-observability.md>), [ai-observability](<https://devfeed.tech/tags/ai-observability.md>), [code](<https://devfeed.tech/tags/code.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [development](<https://devfeed.tech/tags/development.md>), [evals](<https://devfeed.tech/tags/evals.md>), [integration](<https://devfeed.tech/tags/integration.md>), [llm](<https://devfeed.tech/tags/llm.md>), [observability](<https://devfeed.tech/tags/observability.md>), [traces](<https://devfeed.tech/tags/traces.md>)

## AI overview

This article explains how Datadog Agent Observability integrates existing DeepEval and Pydantic Evals frameworks. It covers running evaluations in experiments, connecting evaluation scores to production traces, and continuously monitoring LLM evaluation quality across development and deployment.

## Source excerpt

Run DeepEval and Pydantic Evals natively in Datadog Agent Observability. Track regressions and connect eval scores to production traces.