# How to Build Your First Evaluation Set Before You Have Users

DevFeed: [How to Build Your First Evaluation Set Before You Have Users](<https://devfeed.tech/articles/how-to-build-frontier-lab-quality-evals-with-daniel-mckinnon-ex-pm-at-meta-google-34979.md>)

Original publisher: [Read original article](<https://www.news.aakashg.com/p/how-to-build-your-first-eval>)

Author: Aakash Gupta

Published: 2026-07-28T21:49:23Z

Content type: tutorial

Language: en

Sources: [Product Growth](<https://devfeed.tech/sources/product-growth.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [ChatGPT](<https://devfeed.tech/topics/chatgpt.md>), [llama](<https://devfeed.tech/topics/llama.md>), [Meta](<https://devfeed.tech/topics/meta.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [claude](<https://devfeed.tech/tags/claude.md>), [evals](<https://devfeed.tech/tags/evals.md>), [how-to](<https://devfeed.tech/tags/how-to.md>)

## AI overview

A practical guide to building an AI evaluation set before a product has users. It explains how to create the set in Claude or ChatGPT, score it, interpret the results, and use evals to support development and career growth.

## Source excerpt

He wrote evals for Gemini, for Llama, and for Ray-Ban Meta. Today he builds one from a blank spreadsheet, live!