Writing · Tag

#evals

1 post tagged #evals.

Jul 24, 20266 min read
Your local LLM benchmark is probably lying to you
A local model pass rate can be true and useless at the same time. Here are the three ways local LLM benchmarks mislead you, drawn from real rows on my RTX 5090.
#local-llm#evals#llm-benchmarks#ai-agents

The AI agent build notes

Real costs, real tools, no fluff. M-F when I ship, publish, or learn something worth sending.