How the Agent Decides What to Do Next

A single LLM call is good at one-shot reasoning; it is bad at multi-step tasks where intermediate state matters. Planning loops give the agent an explicit plan, execute the steps, observe results, and revise. The choice of planning loop — ReAct, Plan-and-Execute, ReWOO, Reflexion — is the single biggest lever on latency, cost, and reliability of an agent.

If your agent runs long tasks
  • Your ReAct agent burns 30 LLM calls to answer a 3-step question
  • You picked a planner but can't articulate why it's the right one
  • Your agent never recovers from a tool failure — it just retries forever