What flat scores hide
A stable evaluation score can conceal a regression. Inspect the cases behind the number before deciding a change is ready.
Read article
agentagon
The Agentagon blog
Notes on understanding agent behavior, finding regressions, and proving that a change helps.
A stable evaluation score can conceal a regression. Inspect the cases behind the number before deciding a change is ready.
Read articleTraces record what happened. Evaluations test expectations. Improving an agent needs a deliberate connection between the two.
Read articleTurn a prompt, model, or tool change into a repeatable comparison with explicit expectations and inspectable evidence.
Read article