8.8 KiB
id, type, title, domain, repo, status, owner, created, updated, state_hub_workstream_id
| id | type | title | domain | repo | status | owner | created | updated | state_hub_workstream_id |
|---|---|---|---|---|---|---|---|---|---|
| PMEM-MATURITY-SCORECARD | scorecard | Phase Memory Maturity Scorecard | markitect | phase-memory | active | phase-memory | 2026-05-18 | 2026-05-18 | e82b1c2d-0c5e-47d3-9627-f85e7173dcbe |
Phase Memory Maturity Scorecard
Purpose
Track progress from the current foundation toward the full INTENT.md vision:
a profile-driven, phase-aware memory infrastructure layer for agentic systems.
This scorecard is intentionally practical. It scores what exists in this repo, not what adjacent repositories may already provide.
Scoring Scale
| Score | Meaning |
|---|---|
| 0 | Not started. |
| 1 | Intent or docs exist, but no executable behavior. |
| 2 | Deterministic local library slice exists with tests. |
| 3 | Usable local runtime or CLI exists with stable envelopes. |
| 4 | Integration-ready with policy, persistence, interop, and evaluation coverage. |
| 5 | Service-ready and operationally mature with adapter conformance and diagnostics. |
Milestone Ladder
| Milestone | Target State | Primary Workplans |
|---|---|---|
| M1 | Foundation complete: domain model, contract ingress, dry-run planners, ports, tests. | PMEM-WP-0001 |
| M2 | Usable local runtime: facade, CLI, stable JSON envelopes, local file persistence. | PMEM-WP-0002, PMEM-WP-0003 |
| M3 | Governed interop runtime: review gates, audit, policy-aware activation, Markitect package bridge. | PMEM-WP-0004, PMEM-WP-0005 |
| M4 | Evaluated activation memory: graph neighborhoods, event paths, ranking, quality metrics. | PMEM-WP-0006 |
| M5 | Service-ready adapter layer: service contracts, config, health, external adapter conformance. | PMEM-WP-0007 |
Current Baseline - 2026-05-18
Overall maturity: 3.1 / 5
The repo has crossed from intent-only into a working deterministic library foundation, a usable local runtime facade, a CLI, a file-backed local workspace, and first-slice policy/review/audit gates. It is not yet an interop-complete runtime because richer Markitect package bridge, activation quality, and service contracts remain ahead.
| Dimension | Current | Target | Evidence | Needed Next |
|---|---|---|---|---|
| Intent and boundaries | 4.0 | 5.0 | INTENT.md, SCOPE.md, README.md, architecture doc, PMEM-WP-0001 closure |
Keep boundaries current as runtime behavior expands. |
| Package foundation | 3.0 | 4.0 | Python package, exports, runtime facade, CLI entrypoint, dependency-light tests | Add local persistence and richer adapter configuration. |
| Profile contract ingress | 2.5 | 4.0 | Markitect-compatible profile loading, diagnostics, runtime envelopes | Add validation adapter boundary and compatibility fixture catalog. |
| Graph/event contract ingress | 3.0 | 4.0 | Graph loading, edge endpoint diagnostics, event model, JSONL event log, export, repair diagnostics | Add richer policy-aware import/export checks. |
| Phase domain model | 3.0 | 4.0 | Phases, memory kinds, lifecycle states, actions, explicit path records | Add transition rule profiles and review records. |
| Profile execution planning | 3.0 | 4.0 | Adapter plan, capabilities, policy gates, fallback behavior, CLI output, snapshot fixture | Add profile-driven runtime configuration and compatibility validation. |
| Lifecycle planning | 3.0 | 4.0 | Transition, retention, refresh, compaction dry-run plans, review-gated local apply | Add profile-driven rule evaluation and full review records. |
| Activation planning | 2.5 | 5.0 | Budgeted selection, Markitect-compatible selection output, package request envelope, CLI output | Add graph neighborhoods, event paths, ranking, metadata preservation, metrics. |
| Local persistence | 3.0 | 4.0 | Versioned local workspace, file-backed graph store, JSONL event log, JSONL audit sink | Add migration/repair utilities and stronger durability semantics. |
| Policy and audit | 3.2 | 5.0 | Operation points, policy gateway checks, audit schema, review records, redaction, activation denials | Add external policy adapters and richer audit retention behavior. |
| Observability and diagnostics | 2.5 | 4.0 | Planner diagnostics, runtime diagnostics, event log corruption checks, repair diagnostics, policy denial diagnostics | Add health envelopes and adapter status diagnostics. |
| Markitect interop | 1.5 | 4.0 | Compatible schema constants and selection handoff | Add package bridge envelopes, optional validation/compiler adapters. |
| Kontextual/Infospace interop | 1.0 | 4.0 | Boundaries documented and small derived fixtures | Add delegation envelope design and evaluation fixture reports. |
| Testing and evaluation | 3.2 | 4.0 | 36 deterministic tests over planners, adapters, runtime envelopes, CLI, snapshots, file-store round trips, apply denial, review records, audit schema, and policy redaction | Add activation metrics. |
| Service readiness | 0.5 | 4.0 | Runtime ports exist | Add service contracts, config, health checks, adapter conformance tests. |
| Developer experience | 3.3 | 4.0 | README quick start, package map, runtime facade docs, CLI examples, local persistence guide | Add troubleshooting and richer examples. |
Progress Update - PMEM-WP-0002
Closed on 2026-05-18:
- Added
PhaseMemoryRuntimeas the local application facade. - Added JSON runtime envelopes with policy decisions, audit receipts, diagnostics, dry-run flags, operation ids, and source references.
- Added
phase-memoryconsole script metadata and CLI commands for profile planning, graph lifecycle planning, and graph activation planning. - Added snapshot fixtures for profile-plan and activation-plan envelope shapes.
- Updated local usage and architecture docs.
Remaining maturity blockers:
- File-backed persistence and event path runtime.
- Review-gated apply behavior.
- Policy enforcement and redaction beyond the allow-all local adapter.
- Stronger Markitect compiler/validation bridge.
- Activation quality evaluation.
- Service contracts and external adapter conformance.
Progress Update - PMEM-WP-0003
Closed on 2026-05-18:
- Added a versioned local file-backed workspace layout.
- Added deterministic file-backed profile, node, edge, and path storage.
- Added append-only JSONL event and audit adapters.
- Added graph export, event replay, and repair diagnostics.
- Added explicit conversational path records and path-event helpers.
- Added review-gated lifecycle apply behavior for local stores.
- Added store import/export/repair CLI coverage and local persistence docs.
Remaining maturity blockers:
- Policy operation vocabulary and review records.
- Activation-time policy checks and redaction.
- Stable audit event schema.
- Markitect compiler/validation bridge.
- Activation quality metrics.
- Service readiness and external adapter conformance.
Progress Update - PMEM-WP-0004
Closed on 2026-05-18:
- Added canonical memory operation policy points.
- Added review records and deterministic review ids.
- Added stable audit event schema
phase_memory.audit.event.v1. - Added review-record enforcement for lifecycle apply.
- Added activation policy checks for labels, denied labels, trust zones, secrets, reauthorization, and freshness.
- Added deterministic redaction records and diagnostics for denied activation items.
- Added policy/audit documentation.
Remaining maturity blockers:
- Optional Markitect validation and package compiler bridge.
- Activation ranking and evaluation metrics.
- Service contracts, health diagnostics, and external adapter conformance.
Score Movement Rules
A dimension should move up only when executable behavior and tests exist. Documentation alone can justify score 1, but not score 2 or higher.
Suggested gates:
- Move to 3 when the behavior is usable through the runtime facade or CLI.
- Move to 4 when the behavior has policy, persistence, interop, and regression coverage appropriate to its risk.
- Move to 5 when the behavior has service contracts, health diagnostics, adapter conformance tests, and operational documentation.
Workplan Dependency Map
flowchart TD
WP1["PMEM-WP-0001\nArchitecture and foundation"]
WP2["PMEM-WP-0002\nLocal runtime facade and CLI"]
WP3["PMEM-WP-0003\nFile-backed stores and event paths"]
WP4["PMEM-WP-0004\nPolicy, audit, review gates"]
WP5["PMEM-WP-0005\nMarkitect package bridge"]
WP6["PMEM-WP-0006\nRetrieval and activation quality"]
WP7["PMEM-WP-0007\nService readiness and adapters"]
WP1 --> WP2
WP2 --> WP3
WP2 --> WP4
WP2 --> WP5
WP3 --> WP4
WP5 --> WP6
WP4 --> WP6
WP3 --> WP7
WP4 --> WP7
WP5 --> WP7
WP6 --> WP7
Next Tracking Cadence
Update this scorecard at the end of each workplan closure review:
- record completed task ids
- update dimension scores only when tests and docs support the change
- add residual risks
- list score regressions if behavior was removed or narrowed
- link new workplans if the intent expands