Systematically probe LLM applications for failures — jailbreaks, hallucinations, bias, and unsafe outputs before users find them.
Five passes over the same idea, each from a different angle. Do them in order, or jump to whichever you need.
Red teaming is adversarial testing of LLM systems. Testers try to break system prompts, extract private data, cause harmful outputs, trigger hallucinations, and find edge cases the developers missed. Automated red teaming uses one LLM to attack another at scale. Frameworks like Garak, PyRIT, and custom harnesses make this systematic.
Where this topic shows up outside its home domain: