DSPy
Stanford framework for programming (not prompting) LMs
Verdict
Game-changer for prompt optimisation. Define signatures and let DSPy optimise them with a dataset. Steep learning curve but worth it for production pipelines that need consistent quality.
Other Frameworks & SDKs
- LangChainProduction
Composable LLM application framework — chains, agents, RAG
- LlamaIndexProduction
Data framework for LLM applications — indexing and retrieval
- HaystackStable
Deepset open-source NLP framework for production LLM pipelines
- Semantic KernelProduction
Microsoft's enterprise SDK for AI apps (.NET, Python, Java)
- InstructorProduction
Structured outputs from LLMs using Pydantic schemas
- Vercel AI SDKProduction
TypeScript toolkit for building AI-powered web applications