# Agentic relevance tuning: Letting LLM agents do the search engineering work

DevFeed: [Agentic relevance tuning: Letting LLM agents do the search engineering work](<https://devfeed.tech/articles/agentic-relevance-tuning-letting-llm-agents-do-the-search-engineering-work-12784.md>)

Original publisher: [Read original article](<https://opensearch.org/blog/agentic-relevance-tuning/>)

Author: Kylie Wagar-Dirks

Published: 2026-07-31T15:00:47Z

Content type: article

Language: en

Sources: [OpenSearch](<https://devfeed.tech/sources/opensearch.md>)

Topics: [Amazon OpenSearch Service](<https://devfeed.tech/topics/amazon-opensearch-service.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Framework](<https://devfeed.tech/topics/framework.md>), [data](<https://devfeed.tech/topics/data.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [agents](<https://devfeed.tech/tags/agents.md>), [aws](<https://devfeed.tech/tags/aws.md>), [blog](<https://devfeed.tech/tags/blog.md>), [data](<https://devfeed.tech/tags/data.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [framework](<https://devfeed.tech/tags/framework.md>), [llm-agents](<https://devfeed.tech/tags/llm-agents.md>), [opensearch](<https://devfeed.tech/tags/opensearch.md>), [ranking](<https://devfeed.tech/tags/ranking.md>), [search](<https://devfeed.tech/tags/search.md>)

## AI overview

The article introduces Agentic Relevance Tuning (ART), an end-to-end framework that uses specialized LLM-powered agents to automate search relevance improvement in OpenSearch. ART monitors user behavior, proposes ranking changes, runs offline evaluations, and coordinates deployment when improvements are validated.

## Source excerpt

At OpenSearchCon Europe 2026, Bobby Mohammed (AWS) and Daniel Wrigley (OpenSource Connections) introduced Agentic Relevance Tuning (ART), a framework that uses specialized LLM agents to fully automate the search relevance lifecycle in OpenSearch. The post Agentic relevance tuning: Letting LLM agents do the search engineering work appeared first on OpenSearch.