Articles tagged “evaluation”
3 articles
Testing & Evaluation·13 min read
How Much Testing Is Enough for Your AI Agent?
Code coverage doesn't apply to AI agents. Here's a framework for thinking about evaluation coverage: how many scenarios you need, what distribution to target, and how to know when you've tested enough.
Read More
Testing & Evaluation·13 min read
Your Agent Aced the Benchmark. Production Disagreed.
We scored 92% on GAIA. Production failed the same scenarios 25% of the time. Here's which AI agent benchmarks actually predict deployed performance, why most don't, and what to measure instead.
Read More
Testing & Evaluation·14 min read
Agent Drift: Why Your AI Gets Worse the Longer It Runs
AI agents silently degrade over long conversations. Research quantifies three types of drift and shows why point-in-time evals miss them entirely.
Read More
Changelog MCP y notas para devs
Actualizaciones cortas y ocasionales sobre la spec MCP, nuevas funciones de Protobox y patrones que vemos en producción. Sin marketing innecesario.
