Files
phase-memory/workplans/PMEM-MATURITY-SCORECARD.md

8.8 KiB

id, type, title, domain, repo, status, owner, created, updated, state_hub_workstream_id
id type title domain repo status owner created updated state_hub_workstream_id
PMEM-MATURITY-SCORECARD scorecard Phase Memory Maturity Scorecard markitect phase-memory active phase-memory 2026-05-18 2026-05-18 e82b1c2d-0c5e-47d3-9627-f85e7173dcbe

Phase Memory Maturity Scorecard

Purpose

Track progress from the current foundation toward the full INTENT.md vision: a profile-driven, phase-aware memory infrastructure layer for agentic systems.

This scorecard is intentionally practical. It scores what exists in this repo, not what adjacent repositories may already provide.

Scoring Scale

Score Meaning
0 Not started.
1 Intent or docs exist, but no executable behavior.
2 Deterministic local library slice exists with tests.
3 Usable local runtime or CLI exists with stable envelopes.
4 Integration-ready with policy, persistence, interop, and evaluation coverage.
5 Service-ready and operationally mature with adapter conformance and diagnostics.

Milestone Ladder

Milestone Target State Primary Workplans
M1 Foundation complete: domain model, contract ingress, dry-run planners, ports, tests. PMEM-WP-0001
M2 Usable local runtime: facade, CLI, stable JSON envelopes, local file persistence. PMEM-WP-0002, PMEM-WP-0003
M3 Governed interop runtime: review gates, audit, policy-aware activation, Markitect package bridge. PMEM-WP-0004, PMEM-WP-0005
M4 Evaluated activation memory: graph neighborhoods, event paths, ranking, quality metrics. PMEM-WP-0006
M5 Service-ready adapter layer: service contracts, config, health, external adapter conformance. PMEM-WP-0007

Current Baseline - 2026-05-18

Overall maturity: 3.1 / 5

The repo has crossed from intent-only into a working deterministic library foundation, a usable local runtime facade, a CLI, a file-backed local workspace, and first-slice policy/review/audit gates. It is not yet an interop-complete runtime because richer Markitect package bridge, activation quality, and service contracts remain ahead.

Dimension Current Target Evidence Needed Next
Intent and boundaries 4.0 5.0 INTENT.md, SCOPE.md, README.md, architecture doc, PMEM-WP-0001 closure Keep boundaries current as runtime behavior expands.
Package foundation 3.0 4.0 Python package, exports, runtime facade, CLI entrypoint, dependency-light tests Add local persistence and richer adapter configuration.
Profile contract ingress 2.5 4.0 Markitect-compatible profile loading, diagnostics, runtime envelopes Add validation adapter boundary and compatibility fixture catalog.
Graph/event contract ingress 3.0 4.0 Graph loading, edge endpoint diagnostics, event model, JSONL event log, export, repair diagnostics Add richer policy-aware import/export checks.
Phase domain model 3.0 4.0 Phases, memory kinds, lifecycle states, actions, explicit path records Add transition rule profiles and review records.
Profile execution planning 3.0 4.0 Adapter plan, capabilities, policy gates, fallback behavior, CLI output, snapshot fixture Add profile-driven runtime configuration and compatibility validation.
Lifecycle planning 3.0 4.0 Transition, retention, refresh, compaction dry-run plans, review-gated local apply Add profile-driven rule evaluation and full review records.
Activation planning 2.5 5.0 Budgeted selection, Markitect-compatible selection output, package request envelope, CLI output Add graph neighborhoods, event paths, ranking, metadata preservation, metrics.
Local persistence 3.0 4.0 Versioned local workspace, file-backed graph store, JSONL event log, JSONL audit sink Add migration/repair utilities and stronger durability semantics.
Policy and audit 3.2 5.0 Operation points, policy gateway checks, audit schema, review records, redaction, activation denials Add external policy adapters and richer audit retention behavior.
Observability and diagnostics 2.5 4.0 Planner diagnostics, runtime diagnostics, event log corruption checks, repair diagnostics, policy denial diagnostics Add health envelopes and adapter status diagnostics.
Markitect interop 1.5 4.0 Compatible schema constants and selection handoff Add package bridge envelopes, optional validation/compiler adapters.
Kontextual/Infospace interop 1.0 4.0 Boundaries documented and small derived fixtures Add delegation envelope design and evaluation fixture reports.
Testing and evaluation 3.2 4.0 36 deterministic tests over planners, adapters, runtime envelopes, CLI, snapshots, file-store round trips, apply denial, review records, audit schema, and policy redaction Add activation metrics.
Service readiness 0.5 4.0 Runtime ports exist Add service contracts, config, health checks, adapter conformance tests.
Developer experience 3.3 4.0 README quick start, package map, runtime facade docs, CLI examples, local persistence guide Add troubleshooting and richer examples.

Progress Update - PMEM-WP-0002

Closed on 2026-05-18:

  • Added PhaseMemoryRuntime as the local application facade.
  • Added JSON runtime envelopes with policy decisions, audit receipts, diagnostics, dry-run flags, operation ids, and source references.
  • Added phase-memory console script metadata and CLI commands for profile planning, graph lifecycle planning, and graph activation planning.
  • Added snapshot fixtures for profile-plan and activation-plan envelope shapes.
  • Updated local usage and architecture docs.

Remaining maturity blockers:

  • File-backed persistence and event path runtime.
  • Review-gated apply behavior.
  • Policy enforcement and redaction beyond the allow-all local adapter.
  • Stronger Markitect compiler/validation bridge.
  • Activation quality evaluation.
  • Service contracts and external adapter conformance.

Progress Update - PMEM-WP-0003

Closed on 2026-05-18:

  • Added a versioned local file-backed workspace layout.
  • Added deterministic file-backed profile, node, edge, and path storage.
  • Added append-only JSONL event and audit adapters.
  • Added graph export, event replay, and repair diagnostics.
  • Added explicit conversational path records and path-event helpers.
  • Added review-gated lifecycle apply behavior for local stores.
  • Added store import/export/repair CLI coverage and local persistence docs.

Remaining maturity blockers:

  • Policy operation vocabulary and review records.
  • Activation-time policy checks and redaction.
  • Stable audit event schema.
  • Markitect compiler/validation bridge.
  • Activation quality metrics.
  • Service readiness and external adapter conformance.

Progress Update - PMEM-WP-0004

Closed on 2026-05-18:

  • Added canonical memory operation policy points.
  • Added review records and deterministic review ids.
  • Added stable audit event schema phase_memory.audit.event.v1.
  • Added review-record enforcement for lifecycle apply.
  • Added activation policy checks for labels, denied labels, trust zones, secrets, reauthorization, and freshness.
  • Added deterministic redaction records and diagnostics for denied activation items.
  • Added policy/audit documentation.

Remaining maturity blockers:

  • Optional Markitect validation and package compiler bridge.
  • Activation ranking and evaluation metrics.
  • Service contracts, health diagnostics, and external adapter conformance.

Score Movement Rules

A dimension should move up only when executable behavior and tests exist. Documentation alone can justify score 1, but not score 2 or higher.

Suggested gates:

  • Move to 3 when the behavior is usable through the runtime facade or CLI.
  • Move to 4 when the behavior has policy, persistence, interop, and regression coverage appropriate to its risk.
  • Move to 5 when the behavior has service contracts, health diagnostics, adapter conformance tests, and operational documentation.

Workplan Dependency Map

flowchart TD
  WP1["PMEM-WP-0001\nArchitecture and foundation"]
  WP2["PMEM-WP-0002\nLocal runtime facade and CLI"]
  WP3["PMEM-WP-0003\nFile-backed stores and event paths"]
  WP4["PMEM-WP-0004\nPolicy, audit, review gates"]
  WP5["PMEM-WP-0005\nMarkitect package bridge"]
  WP6["PMEM-WP-0006\nRetrieval and activation quality"]
  WP7["PMEM-WP-0007\nService readiness and adapters"]

  WP1 --> WP2
  WP2 --> WP3
  WP2 --> WP4
  WP2 --> WP5
  WP3 --> WP4
  WP5 --> WP6
  WP4 --> WP6
  WP3 --> WP7
  WP4 --> WP7
  WP5 --> WP7
  WP6 --> WP7

Next Tracking Cadence

Update this scorecard at the end of each workplan closure review:

  • record completed task ids
  • update dimension scores only when tests and docs support the change
  • add residual risks
  • list score regressions if behavior was removed or narrowed
  • link new workplans if the intent expands