tegwick
b48a2102d7
Add Helix Forge correlation (HELIX_SESSION_UID env, metrics correlate), artifact-store publish (metrics publish), activity-core ActivityDefinition references, integration patterns docs, and canon/knowledge design artifacts.
43 lines
1.4 KiB
Markdown
43 lines
1.4 KiB
Markdown
---
|
|
id: kaizen-low-success-rate-review
|
|
name: Low Agent Success Rate Review
|
|
enabled: false
|
|
owner: kaizen-agentic
|
|
governance: custodian
|
|
status: proposed
|
|
trigger:
|
|
type: event
|
|
event_type: kaizen.metrics.recorded
|
|
context_sources:
|
|
- type: event-payload
|
|
bind_to: context.metrics
|
|
---
|
|
|
|
# Low Agent Success Rate Review
|
|
|
|
When a project agent's rolling success rate drops below 0.8, create a review
|
|
task in issue-core for human or optimizer-agent follow-up.
|
|
|
|
```rule
|
|
id: flag-low-success-rate
|
|
condition: 'context.metrics.summary.success_rate < 0.8 && context.metrics.summary.execution_count >= 5'
|
|
action:
|
|
task_template: "Review {{context.metrics.agent}} success rate ({{context.metrics.summary.success_rate}})"
|
|
description: |
|
|
Agent {{context.metrics.agent}} in {{context.metrics.project}} has success_rate
|
|
below 0.8 over {{context.metrics.summary.execution_count}} executions.
|
|
Run: kaizen-agentic metrics show {{context.metrics.agent}}
|
|
Then: kaizen-agentic metrics optimize {{context.metrics.agent}}
|
|
target_repo: "{{context.metrics.project}}"
|
|
priority: high
|
|
labels: ["kaizen", "metrics", "review", "automated"]
|
|
```
|
|
|
|
**Threshold:** 0.8 success rate, minimum 5 executions (avoids noise on early pilots).
|
|
|
|
**CLI mapping:** Event emitter is future work; manual check today:
|
|
|
|
```bash
|
|
kaizen-agentic metrics show <agent> # inspect summary.success_rate
|
|
kaizen-agentic metrics optimize <agent>
|
|
``` |