Automated tests for AI: fixed cases, scored by code or a judge model, run on every change.
- CasesReal inputs with what a good answer must contain.
- GradersCode checks, then a judge model for fuzzy parts.
- RunRun on every prompt or model change.
- TrackCompare scores over time.
Explain 1/5
Source: Claude docs: Define success and build evaluations