The error log is the product.
Arjun Mehta
Agent engineer
Accuracy is an average. Errors are specific, and they’re where the value is.
Accuracy is an average
“97% accurate” tells you almost nothing. You need to know which 3% and what each one cost. That’s why we treat the error log as the main thing we hand over.
What goes in the log
Every task, what the agent saw, what it decided, how sure it was and what happened next. When a person corrects it, the correction goes in the log too.
Read it together once a month
The monthly review takes less than an hour. We sort the misses by cost, fix the top three and agree whether any limit should move. Most of the value of an agent after launch comes from this one meeting.
Publish your misses
Clients trust an agent more when they can see what it got wrong. At Calder Freight, the agent caught three invoices that would have been paid twice, and it made mistakes of its own in week one. Both went in the same report.
