Skip to content

UseAI glossary

LLM judge

Having one model grade another system's answers against a rubric. It scales, but you need to calibrate it by comparing its scores to a human's on around thirty cases, and be aware of its biases: it prefers longer responses.

In other words

A full-time food critic. Useful, provided you've checked that their tastes match those of your clients.

Go further at the Academy

See also

More in this family: Use

Find it in the full glossary →All the terms