The Practice · Glossary
Eval
An eval, short for evaluation, is a repeatable test of an AI system's output against a set standard: sample tasks, the results you would accept and a way to score them. It tells you whether a change to a prompt, a skill or a model made the work better or worse.
Keep five real past requests and the answers you would accept. Run them again whenever you change a skill or switch tools. See The Grading Room.
Educational, not professional advice. Nothing on this page is affiliated with or endorsed by its publisher.

