Product
5 min
Dev Raman
When a grader is another model, it can be fooled by a confident answer. So in v2.3.0 graders can call tools: they can look up the order, check the refund and compare it to what the bot told the customer.
If the refund does not exist, the case fails, however polite the reply was.