After launch, how do you find what to improve in an agent?
Why D is the answer
Review metrics and user feedback
Metrics and user feedback show where an agent falls short, so improvements can target real problems.
In detail
- Metrics and user feedback show what to fix.
- Set a regular review.
Use case
An illustrative scenario, not a real incident.
After launch, a team reviews escalation rates and comments, and finds three topics to improve.
See it in different ways
flowchart LR A["Agent metrics"] --> B["User feedback and backlog"] B --> C["Tune"] C --> A
stateDiagram-v2 [*] --> Pilot Pilot --> Measure Measure --> Improve: low ratings on a topic Improve --> Measure Measure --> Expand: targets met Measure --> Rollback: serious problem
stateDiagram-v2 state "Monitor" as s0 state "Review feedback" as s1 state "Improve" as s2 [*] --> s0 s0 --> s1 s1 --> s2 s2 --> s0
Key point: Metrics and feedback guide improvement.
Why the other options are wrong
- A. Wait for the annual planning review
- A yearly review is too slow.
- B. Double the number of topics at random
- Random topics add noise.
- C. Turn off the logs to reduce cost
- Without logs, you cannot see problems.