AI Wisdom

AI Wisdom reference · Radar · 62 entries

AI Engineering Radar

The tools, techniques and platforms we actually run in production, each placed on a ring: Adopt, Trial, Assess or Hold. Names are open to everyone; the reasoning behind each call is part of Pro.

Last reviewed · 29 entries new or moved this review

AdoptTrialAssessHold
AI Engineering Radar: 62 entries across four rings and four quadrantsAdoptTrialAssessHoldTechniquesPlatforms & modelsTools & librariesLanguages & infrastructure1. Context Engineering — Adopt12. Least-Agency Design — Adopt23. Repo Instructions (AGENTS.md) — Adopt34. Sandboxing Generated Code — Adopt45. Retrieval-Augmented Generation (RAG) — Adopt56. Structured Outputs — Adopt67. Tool Use / Function Calling — Adopt78. AI Gateway Pattern — Adopt89. Semantic Caching — Adopt910. Eval-Driven Development — Adopt1011. Input / Output Guardrails — Adopt1112. Harness Engineering — Trial1213. Durable Execution for Agents — Trial1314. Agent Skills — Trial1415. Agent Memory (short and long term) — Trial1516. Agent Orchestration (Plan-Execute / Graphs) — Trial1617. Chain-of-Thought Prompting — Trial1718. Model Fine-tuning (LoRA/QLoRA) — Trial1819. Red Teaming LLM Features — Trial1920. Spec-Driven Development — Assess2021. Voice Agents — Assess2122. Tree-of-Thought Prompting — Assess2223. Multi-Agent by Default — Hold2324. Long-Context Stuffing Instead of Retrieval — Hold2425. Parsing Free-Text Output with Regex — Hold2526. Unbounded Autonomous Agent Loops — Hold2627. OpenAI API (GPT-6 family) — Adopt2728. Anthropic Claude (5.5 family) — Adopt2829. Google Gemini (4 Argon, 3.8 Flash) — Adopt2930. Azure OpenAI — Adopt3031. Vercel AI SDK — Adopt3132. Microsoft Agent Framework — Trial3233. LangGraph — Trial3334. Semantic Kernel — Trial3435. LlamaIndex — Trial3536. Open-Weight Models (DeepSeek V4, Qwen 3.8, Llama 4) — Trial3637. Mistral — Trial3738. A2A Protocol — Assess3839. AutoGen — Assess3940. LangChain — Assess4041. AWS Bedrock — Assess4142. Model Context Protocol (MCP) — Adopt4243. pgvector — Adopt4344. Pinecone — Adopt4445. OpenTelemetry for LLM Apps — Adopt4546. Langfuse — Adopt4647. Instructor / Zod — Adopt4748. AI Coding Agents (Claude Code, Codex, Cursor, Copilot) — Adopt4849. Arize Phoenix — Trial4950. Qdrant — Trial5051. Weaviate — Trial5152. vLLM — Trial5253. LiteLLM — Trial5354. Helicone — Trial5455. LangSmith — Assess5556. Weights & Biases — Assess5657. Python (AI engineering) — Adopt5758. TypeScript (AI features) — Adopt5859. Terraform for AI Infrastructure — Adopt5960. C# / .NET (enterprise AI) — Trial6061. Bicep (Azure AI deployments) — Trial6162. Pulumi (TypeScript) — Assess62

How to read it

Closer to the centre means more confident

Each dot is numbered; select one to jump to its entry below.

AdoptWe use these in production and recommend them broadly.
26
TrialWorth pursuing. Evaluate for your specific context.
22
AssessWorth exploring, but handle with care and clear evaluation criteria.
10
HoldProceed with caution. We have found issues or better alternatives exist.
4
Pro

See why, not just what

Adopt is open to everyone. Pro unlocks the reasoning behind every Trial, Assess and Hold call: the trade-offs, costs and failure modes behind each ring.

See plans

Architecture, prompting and agent patterns

Techniques

26 entries

Adopt

1

Context Engineering

New

Treat the window as a budget and decide what goes in on every turn. Bigger windows did not solve this: stale and irrelevant context makes agents slower, costlier and less reliable.

2

Least-Agency Design

New

Give an agent only the autonomy its task needs, and enforce policy in code at the tool boundary. Prompt rules can be argued with. Code cannot.

3

Repo Instructions (AGENTS.md)

New

A short file of exact commands and non-obvious rules, now a shared format across coding tools. The cheapest improvement you can make to any coding agent.

4

Sandboxing Generated Code

New

Run model-written code with egress denied by default and no long-lived secrets. Permission prompts alone are not a boundary once a prompt injection is in play.

5

Retrieval-Augmented Generation (RAG)

The default architecture for grounding LLM responses in private or current knowledge. Mature tooling, well-understood failure modes. Bigger context windows changed how much you retrieve, not whether you should.

6

Structured Outputs

Schema-constrained decoding is native across current GPT, Claude and Gemini models. Define the schema once, validate on the way in, and stop parsing prose.

7

Tool Use / Function Calling

LLMs calling typed external functions. Reliable across every current frontier family and the foundation for agent systems.

8

AI Gateway Pattern

One choke point for every model call: auth, rate limits, semantic caching, cost attribution and provider failover. The first piece of infrastructure we add once more than one team calls an LLM.

9

Semantic Caching

Cache LLM responses by semantic similarity of prompts, usually at the gateway with Redis or another vector-capable store. It can cut cost and latency, but a similar question can get the wrong answer, so tune the threshold per route and scope the cache by tenant.

10

Eval-Driven Development

A versioned eval set that runs in CI on every prompt, model or retrieval change, with LLM-as-judge for open-ended answers and deterministic checks where possible. Model upgrades are now monthly; this is how you take them safely.

11

Input / Output Guardrails

New

Validate what goes into the model and what comes out: prompt-injection screening, PII redaction, schema and policy checks on outputs. Cheap to add early, expensive to retrofit after an incident.

Hold

Model providers and AI frameworks

Platforms & models

15 entries

Adopt

27

OpenAI API (GPT-6 family)

GPT-6 Astra for the hardest reasoning, GPT-6.1 Sol as the balanced default, GPT-6 Luna for high-volume paths. Strong ecosystem and predictable pricing.

28

Anthropic Claude (5.5 family)

Claude Opus 5.5 and Sonnet 5.5 lead our coding and agentic workloads; Haiku 5.5 covers fast, cheap paths. Excellent tool use and long-context behaviour.

29

Google Gemini (4 Argon, 3.8 Flash)

New

Gemini 4 Argon for the hardest multimodal and long-context work; Gemini 3.8 Flash and 3.5 Flash-Lite suit high-throughput workloads. Argon and Flash prices both rise in the next few months, so re-run your cost sums.

30

Azure OpenAI

OpenAI models with private networking, regional data residency and Entra ID. Model availability trails openai.com: GPT-5.6 is the current Azure deployment. Plan upgrades around Azure’s rollout, not OpenAI’s launch date.

31

Vercel AI SDK

Streaming-first AI primitives for Next.js / React with one interface across providers. Excellent DX for UI-layer AI features and tool calling.

Vector stores, observability, serving and dev tooling

Tools & libraries

15 entries

Adopt

42

Model Context Protocol (MCP)

New

The standard way to expose tools and data to agents across vendors, now stateless since the 2026-07-28 revision and hosted by the Agentic AI Foundation. Build a tool once as an MCP server and every MCP-capable client can use it. Treat servers as privileged code: scope credentials and log every call.

43

pgvector

Vector search inside Postgres. Removes a separate vector DB at moderate scale, and runs on Neon, Supabase or Azure Database for PostgreSQL.

45

OpenTelemetry for LLM Apps

New

Emit model calls, tool calls and retrieval steps as standard OTel spans (GenAI semantic conventions). Your traces then work in any backend, and you are not locked into one LLM-ops vendor. The conventions are still in Development status, so keep attribute names in one wrapper.

46

Langfuse

Open-source LLM ops: tracing, evals, prompt management. Self-hostable, and part of ClickHouse since January 2026 with its core still MIT-licensed. Our recommended observability layer for production AI.

47

Instructor / Zod

Schema-first validation of model output: Instructor (Pydantic) in Python, Zod in TypeScript, both with retries on invalid output. The thin layer we put over native structured outputs.

48

AI Coding Agents (Claude Code, Codex, Cursor, Copilot)

Agentic coding tools that read the repo, run commands and open PRs. Useful in the hands of experienced engineers. The bottleneck has moved to review, so keep diffs small and give agents tests to run.

Where each language and IaC tool earns its place

Languages & infrastructure

6 entries

Adopt

57

Python (AI engineering)

Dominant language for AI engineering. Best ecosystem for model inference, evals, ML tooling and data pipelines.

58

TypeScript (AI features)

For product and edge AI features: streaming UI, tool calling, MCP servers and the Vercel AI SDK. TypeScript is the right choice here.

59

Terraform for AI Infrastructure

New

Model endpoints, vector stores, gateways and keys belong in code like everything else. Reusable modules make a new AI environment a pull request, not a week of portal clicks.

Go from the call to the build

Radar entries map to topics in the universe. Read the article, see the architecture, then build it in the five-mode loop.