# How we optimized Dash's relevance judge with DSPy

DevFeed: [How we optimized Dash's relevance judge with DSPy](<https://devfeed.tech/articles/how-we-optimized-dash-s-relevance-judge-with-dspy-179.md>)

Original publisher: [Read original article](<https://dropbox.tech/machine-learning/optimizing-dropbox-dash-relevance-judge-with-dspy>)

Author: Yasmin McDowell,Lawrence Good,Ilya Yakovlev,Andrew Cheung,Binoy Dash,Simran Jumani,Dmitriy Meyerzon,Mark Breitenbach,Ishan Mishra,Kazuaki Okumura,Mike White,Kevin Altschuler,Facundo Agriel,Ishan Mishr

Published: 2026-03-17T17:00:00Z

Content type: article

Language: en

Sources: [Dropbox Tech Blog](<https://devfeed.tech/sources/dropbox-tech-blog.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [cost](<https://devfeed.tech/tags/cost.md>), [dash](<https://devfeed.tech/tags/dash.md>), [dspy](<https://devfeed.tech/tags/dspy.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [framework](<https://devfeed.tech/tags/framework.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [models](<https://devfeed.tech/tags/models.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [performance](<https://devfeed.tech/tags/performance.md>), [production](<https://devfeed.tech/tags/production.md>), [prompt-engineering](<https://devfeed.tech/tags/prompt-engineering.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

Dropbox describes using DSPy to optimize an LLM relevance judge for Dash, aiming to improve agreement with human labels while reducing cost and improving production reliability.

## Source excerpt

We used DSPy to turn prompt engineering for our relevance judge into a measurable, automated optimization loop, improving task performance, cost, and how reliably it works in production.