LLM Evals

Standard benchmarks tell you general capability. Custom evals tell you if a model works for YOUR use case. Build evaluation datasets from real user queries, define scoring rubrics (LLM-as-judge, human eval, exact match), track eval scores across model versions, and use A/B testing for final decisions.