maturity scorecard generation

workplans/OPEN-CMIS-TCK-WP-0002-live-test-infrastructure.md

@@ -10,7 +10,7 @@ owner: codex
 planning_priority: high
 planning_order: 3
 created: "2026-05-07"
-updated: "2026-05-07"
+updated: "2026-05-08"
 depends_on:
   - "OPEN-CMIS-TCK-WP-0001"
 state_hub_workstream_id: "da3f0d16-ba8e-4147-b0fc-ab3462e0b7b0"
@@ -104,7 +104,7 @@ Progress:
 
 ```task
 id: OPEN-CMIS-TCK-WP-0002-T002
-status: in_progress
+status: done
 priority: high
 state_hub_task_id: "f993c1ef-8e6f-4ad1-8375-4487887deb8b"
 ```
@@ -128,6 +128,16 @@ Progress:
 - Added `docs/LOCAL-RUNBOOK.md` with the local sequence from dry-run adapter
   check through Java/Maven install, Maven dependency resolution, and first real
   guide-board run.
+- Added regression coverage for both the blocked local posture and a ready path
+  using a fake Java/Maven toolchain, so the command behavior is stable while the
+  actual workstation prerequisites remain to be installed.
+- Added `scripts/install_local_toolchain.py` as a no-sudo path that installs a
+  local JDK/Maven toolchain under `.local/toolchains`, writes `env.sh`, and
+  keeps downloaded runtime assets out of version control.
+- Ran the local installer on this WSL workspace. It installed Temurin JDK
+  17.0.19 and Apache Maven 3.9.11 under `.local/toolchains`.
+- Ran `scripts/bootstrap_opencmis_tck.py --resolve` with the local toolchain;
+  the runtime summary reports `ready` and Maven dependency resolution succeeded.
 
 ## D2.3 - OpenCMIS TCK Adapter Invocation
 
@@ -161,8 +171,14 @@ Progress:
   artifact capture without requiring Java/Maven.
 - The guide-board dry-run captures redacted session properties and group lists
   as fingerprinted assessment artifacts.
-- Live execution remains blocked until Java/Maven are installed and Maven can
-  resolve the TCK runtime.
+- Local Java/Maven are now installed under `.local/toolchains`, and Maven has
+  resolved the OpenCMIS TCK runtime.
+- Ran a non-dry ConsoleRunner adapter smoke against an intentionally unreachable
+  local URL. Maven launched the real TCK runner, captured session properties,
+  group list, invocation metadata, stdout, and stderr, and correctly returned
+  `infrastructure_error` because no CMIS target was reachable.
+- Live repository/type execution remains open until a reachable CMIS Browser
+  Binding target is available.
 
 ## D2.4 - Target Profiles And Credential References
 
@@ -198,7 +214,7 @@ Progress:
 
 ```task
 id: OPEN-CMIS-TCK-WP-0002-T005
-status: todo
+status: done
 priority: high
 state_hub_task_id: "03ba9506-cce8-44fa-a036-2ab1ffc7a176"
 ```
@@ -214,11 +230,24 @@ Acceptance:
 - Add fixtures derived from real sanitized output so normalization remains
   regression-tested.
 
+Progress:
+
+- Added `open_cmis_tck.normalization` as the shared OpenCMIS result parser.
+- The ConsoleRunner adapter now parses Apache Chemistry `TextReport` stdout and
+  emits case-level evidence with native status, guide-board status, group/test
+  names, source location, selected check group, and group class facts.
+- The guide-board wrapper now accepts native TextReport output directly in
+  addition to adapter JSON and JUnit-style XML.
+- Added a sanitized TextReport-format fixture and regression tests for direct
+  parsing and guide-board run normalization.
+- Documented the TextReport normalization path in the runner and local runtime
+  docs.
+
 ## D2.6 - Live Pilot Run
 
 ```task
 id: OPEN-CMIS-TCK-WP-0002-T006
-status: todo
+status: in_progress
 priority: high
 state_hub_task_id: "d9eb9384-3352-4b71-9918-57282ee00411"
 ```
@@ -233,11 +262,24 @@ Acceptance:
   blocked by infrastructure, or were unsupported by design.
 - Known gaps do not hide unexpected failures in the same capability group.
 
+Progress:
+
+- Local Java/Maven/TCK runtime is ready via `.local/toolchains`.
+- Probed the configured `kontextual-cmis-compat` Browser Binding URL
+  `http://127.0.0.1:8000/cmis/compat-tck/browser`; it currently returns HTTP
+  404, so the CMIS target is not reachable at the profile URL.
+- Ran a guide-board baseline attempt into
+  `.local/runs/open-cmis-tck-live-attempt`; it produced a run directory,
+  assessment package, Markdown report, retention summary, and CMIS maturity
+  scorecard with status `infrastructure_error` at preflight.
+- Live pilot execution is blocked on starting or providing a reachable CMIS
+  Browser Binding endpoint and, if needed, credentials.
+
 ## D2.7 - CMIS Capability Maturity Scorecard
 
 ```task
 id: OPEN-CMIS-TCK-WP-0002-T007
-status: todo
+status: done
 priority: high
 state_hub_task_id: "7365052f-0d76-4fb2-b32c-236476b0f937"
 ```
@@ -251,6 +293,14 @@ Acceptance:
 - Generate a compact JSON scorecard and Markdown summary suitable for downstream
   product-quality tracking.
 
+Progress:
+
+- Added `open_cmis_tck.scorecard` and `scripts/cmis_scorecard.py`.
+- The scorecard reads guide-board evidence, findings, mappings, and assessment
+  package outputs and writes JSON/Markdown reports.
+- Added `docs/CMIS-MATURITY-SCORECARD.md` and linked scorecard generation from
+  the local runbook.
+
 ## D2.8 - Operator Documentation
 
 ```task