# Evaluating LLMs for my personal use case

DevFeed: [Evaluating LLMs for my personal use case](<https://devfeed.tech/articles/evaluating-llms-for-my-personal-use-case-35441.md>)

Original publisher: [Read original article](<https://darkcoding.net/software/personal-ai-evals-aug-2025/>)

Author: Graham King

Published: 2025-08-23T17:00:00Z

Content type: opinion

Language: en

Sources: [Graham King](<https://devfeed.tech/sources/graham-king.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Programming](<https://devfeed.tech/topics/programming.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Rust](<https://devfeed.tech/topics/rust.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Linux](<https://devfeed.tech/topics/linux.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [coding](<https://devfeed.tech/tags/coding.md>), [devstral](<https://devfeed.tech/tags/devstral.md>), [evals](<https://devfeed.tech/tags/evals.md>), [latency](<https://devfeed.tech/tags/latency.md>), [linux](<https://devfeed.tech/tags/linux.md>), [llms](<https://devfeed.tech/tags/llms.md>), [programming](<https://devfeed.tech/tags/programming.md>), [python](<https://devfeed.tech/tags/python.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [qwen3](<https://devfeed.tech/tags/qwen3.md>), [software](<https://devfeed.tech/tags/software.md>)

## AI overview

The author evaluates a set of language models against 130 real prompts drawn from personal bash history, covering programming, system administration, technical explanations, general knowledge, and creative tasks. The evaluation uses blinded Rust scripts and records cost, latency, and throughput, with models selected based on prior experience, leaderboards, and price.

## Source excerpt

My life is not a math Olympiad