Constrained Generation

Constrained generation enforces output structure at the token level. Instead of hoping the model produces valid JSON or SQL, you enforce it by masking invalid tokens during sampling. Tools like Outlines, Guidance, LMQL, and llama.cpp grammars make this practical. This is the most reliable way to get structured output from open-weight models.