Braintrust
End-to-end LLM evaluation and experimentation platform
Verdict
Fastest SDK for building evaluation pipelines. Dataset versioning, scorer plugins, and team review workflows are polished. Growing fast in enterprise evaluations space.
Other Observability & Evals
- Arize AIStable
ML and LLM observability platform with drift detection and evaluation
- HeliconeStable
LLM gateway with logging, caching, and cost analytics
- LangfuseProduction
Open-source LLM engineering platform — traces, evals, prompts
- OpenLLMetryExperimental
OpenTelemetry-based observability for LLMs
- Phoenix (Arize)Stable
Open-source AI observability with embedding and RAG tracing
- PromptLayerStable
Prompt version control, A/B testing, and analytics platform