AI model evaluation
AI model evaluation checks whether a system meets quality and behaviour criteria on defined tasks
What it means, how it is used and where it comes up, with its related concepts.
What it is and how it works
It uses test cases, metrics and human review depending on the context. It should include frequent, difficult and failure cases. A good result on a public benchmark does not prove that the system works well with an organisation's data and needs.
Also known as
Evals, AI evaluation
Topics