tegwick
1641a3165d
Publish activity-core EventEnvelope payloads to NATS subject activity.kaizen.metrics.recorded after a successful append. Optional nats-py via kaizen-agentic[events]; project slug from KAIZEN_PROJECT_SLUG or directory basename. Skips emit on idempotency duplicates. Closes KAIZEN-WP-0008 T03.
46 lines
1.5 KiB
Markdown
46 lines
1.5 KiB
Markdown
---
|
|
id: kaizen-low-success-rate-review
|
|
name: Low Agent Success Rate Review
|
|
enabled: false
|
|
owner: kaizen-agentic
|
|
governance: custodian
|
|
status: proposed
|
|
trigger:
|
|
type: event
|
|
event_type: kaizen.metrics.recorded
|
|
context_sources:
|
|
- type: event-payload
|
|
bind_to: context.metrics
|
|
---
|
|
|
|
# Low Agent Success Rate Review
|
|
|
|
When a project agent's rolling success rate drops below 0.8, create a review
|
|
task in issue-core for human or optimizer-agent follow-up.
|
|
|
|
```rule
|
|
id: flag-low-success-rate
|
|
condition: 'context.metrics.summary.success_rate < 0.8 && context.metrics.summary.execution_count >= 5'
|
|
action:
|
|
task_template: "Review {{context.metrics.agent}} success rate ({{context.metrics.summary.success_rate}})"
|
|
description: |
|
|
Agent {{context.metrics.agent}} in {{context.metrics.project}} has success_rate
|
|
below 0.8 over {{context.metrics.summary.execution_count}} executions.
|
|
Run: kaizen-agentic metrics show {{context.metrics.agent}}
|
|
Then: kaizen-agentic metrics optimize {{context.metrics.agent}}
|
|
target_repo: "{{context.metrics.project}}"
|
|
priority: high
|
|
labels: ["kaizen", "metrics", "review", "automated"]
|
|
```
|
|
|
|
**Threshold:** 0.8 success rate, minimum 5 executions (avoids noise on early pilots).
|
|
|
|
**CLI mapping:** `kaizen-agentic metrics record <agent> --emit-event` after each
|
|
append (see [kaizen-metrics-recorded-event.md](../kaizen-metrics-recorded-event.md)).
|
|
Manual check today:
|
|
|
|
```bash
|
|
kaizen-agentic metrics show <agent> # inspect summary.success_rate
|
|
kaizen-agentic metrics optimize <agent>
|
|
```
|