Tag
evaluation
6 articles tagged with “evaluation”
Testing LLM-Powered Features Without Going Broke
Mock strategies, evaluation harnesses, snapshot testing, and cost-aware CI for LLM-integrated applications.
LLM Evaluation Beyond Vibes
Systematic approaches to evaluating LLM outputs — automated metrics, human evaluation frameworks, regression testing, and building evaluation pipelines.
Meta-Prompting: Letting a Model Tune Your Prompts
From a one-off rewrite to refinement loops on failures, candidate search and compiled DSPy programs. How to optimise prompts against a metric without overfitting, and how to review what the optimiser produces.
LangSmith: LLM Observability Platform
LangChain's observability platform — distributed tracing, dataset curation, evaluation suites, and the prompt playground, for LangChain and framework-agnostic apps alike.
LLM Evaluation Frameworks Compared
Promptfoo, DeepEval, RAGAS, LangSmith and Phoenix compared by what each is good at, with working examples and a way to choose.
Hallucination Testing: Measuring What the Model Makes Up
The three kinds of hallucination, a test set that includes questions with no answer, claim-by-claim faithfulness scoring, and what lowers the rate.