tegwick
bd74d7d122
Persist INTENT and ecosystem assessments in history/, add ADR-004 for project metrics with Helix Forge correlation, and register WP-0003 and WP-0004 workplans with State Hub. Update SCOPE, README, and agency-framework docs to reflect the two-layer measurement model.
87 lines
3.2 KiB
Markdown
87 lines
3.2 KiB
Markdown
# KaizenAgentic Intent Gap Analysis
|
|
|
|
**Date:** 2026-06-16
|
|
**Scope:** `INTENT.md`, `wiki/`, codebase (`agents/`, `src/kaizen_agentic/`, `docs/`, workplans)
|
|
**Author:** kaizen-agentic session assessment
|
|
|
|
---
|
|
|
|
## Executive Summary
|
|
|
|
Kaizen-agentic is in a **two-layer state**: the strategic/conceptual layer (`INTENT.md`, `wiki/`) is well-developed; the operational layer (agents, CLI, agency framework) is substantial but implements a **deployment and memory** product more than a **measurable continuous-improvement engine**.
|
|
|
|
The largest gap: the **measurement → optimization → specification refinement loop** described in INTENT is largely unbuilt. Addressed by **KAIZEN-WP-0003** (registered 2026-06-16).
|
|
|
|
---
|
|
|
|
## Alignment
|
|
|
|
| INTENT asset | Status |
|
|
|--------------|--------|
|
|
| Mission and conceptual model | `wiki/` established |
|
|
| KaizenAgent definition template | `wiki/KaizenAgentTemplate.md` — not enforced in agents |
|
|
| Meta-optimizer concept | `wiki/AgentKaizenOptimizer.md` + `agent-optimization.md` — no data pipeline |
|
|
| Idempotent/measurable principles | Documented; not in agent implementations |
|
|
| Codebase improvement guidance | `wiki/KaizenGuidance.md` — vision only |
|
|
| Prompts/experiments/mantras | `wiki/KaizenPrompting.md` — not operationalized |
|
|
| Product/pricing/brand | `wiki/` complete |
|
|
| Agency memory + Coach | WP-0002 shipped |
|
|
| CLI deployment | Functional (21 agents) |
|
|
|
|
---
|
|
|
|
## Critical Gaps
|
|
|
|
### 1. Kaizen loop not closed
|
|
|
|
INTENT requires evidence-based refinement with before/after deltas. Reality: `OptimizationLoop` exists but is unwired; no `.kaizen/metrics/`; WP-0001 telemetry unstarted.
|
|
|
|
### 2. Agent template not enforced
|
|
|
|
Agents use minimal YAML frontmatter; `wiki/KaizenAgentTemplate.md` (metrics, idempotency, testing, evolution) is reference only.
|
|
|
|
### 3. KaizenGuidance unbuilt
|
|
|
|
No guide catalog, manifests, codemods, or Parse→Measure pipeline.
|
|
|
|
### 4. Coach vs optimizer not integrated
|
|
|
|
Qualitative memory (Coach) and quantitative optimization (optimizer) are separate paths.
|
|
|
|
### 5. Agent implementation boundary undeclared
|
|
|
|
INTENT says repo should not own all concrete agent implementations; 21 agents live here as reference fleet — interim state needs explicit policy.
|
|
|
|
---
|
|
|
|
## Design Principles Scorecard
|
|
|
|
| Principle | Status |
|
|
|-----------|--------|
|
|
| Continuous Improvement | Partial (memory; no automated refinement) |
|
|
| Measurable by Default | Gap |
|
|
| Idempotent Operations | Gap |
|
|
| Evidence over Intuition | Gap |
|
|
| Separation of Concerns | Partial |
|
|
| Composable Capabilities | Gap |
|
|
| Human-Readable + Machine-Executable | Gap (guidance) |
|
|
| Rollback-Ready Evolution | Partial |
|
|
| Compounding Value | Partial (memory only) |
|
|
|
|
---
|
|
|
|
## Remediation Sequence
|
|
|
|
1. **WP-0003** — metrics convention, CLI, optimizer wiring, Coach bridge (active)
|
|
2. **WP-0004** — ecosystem integration (agentic-resources, activity-core, artifact-store)
|
|
3. Future — KaizenGuidance catalog, phase-memory upgrade, full template conformance
|
|
|
|
---
|
|
|
|
## Related Artifacts
|
|
|
|
- `SCOPE.md` — updated 2026-06-16
|
|
- `workplans/kaizen-agentic-WP-0003-measurement-loop.md`
|
|
- `history/2026-06-16-ecosystem-assessment.md`
|
|
- `wiki/EcosystemIntegration.md`
|
|
- `docs/adr/ADR-004-project-metrics-convention.md` |