Articles tagged “evaluation”
3 articles
Testing & Evaluation·13 min read
How Much Testing Is Enough for Your AI Agent?
Code coverage doesn't apply to AI agents. Here's a framework for thinking about evaluation coverage: how many scenarios you need, what distribution to target, and how to know when you've tested enough.
Read More
Testing & Evaluation·13 min read
Your Agent Aced the Benchmark. Production Disagreed.
We scored 92% on GAIA. Production failed the same scenarios 25% of the time. Here's which AI agent benchmarks actually predict deployed performance, why most don't, and what to measure instead.
Read More
Testing & Evaluation·14 min read
Agent Drift: Why Your AI Gets Worse the Longer It Runs
AI agents silently degrade over long conversations. Research quantifies three types of drift and shows why point-in-time evals miss them entirely.
Read More
MCP changelog and dev notes
Short, occasional updates on the MCP spec, new Protobox features, and patterns we've seen in production. No marketing fluff.
