generated from coulomb/repo-seed
Log analysis functionality for self-assessment
This commit is contained in:
@@ -193,12 +193,35 @@ PYTHONPATH=src python3 scripts/cmis_scorecard.py \
|
||||
--run-dir /tmp/open-cmis-tck-live
|
||||
```
|
||||
|
||||
Generate the log review after the scorecard:
|
||||
|
||||
```sh
|
||||
PYTHONPATH=src python3 scripts/opencmis_log_review.py \
|
||||
--run-dir /tmp/open-cmis-tck-live
|
||||
```
|
||||
|
||||
The review classifies warnings, hard errors, stderr, skipped cases, and closed
|
||||
warnings when a previous run is supplied. The default warning policy accepts the
|
||||
OpenCMIS HTTP transport warning only for local/test loopback profiles.
|
||||
|
||||
For important product assessments, archive the run before `/tmp` cleanup:
|
||||
|
||||
```sh
|
||||
PYTHONPATH=src python3 scripts/archive_assessment_run.py \
|
||||
--run-dir /tmp/open-cmis-tck-live \
|
||||
--archive-root .local/runs/archive
|
||||
```
|
||||
|
||||
The archive writes `.local/runs/archive/<target>/<run-id>/archive-manifest.json`
|
||||
with SHA-256 hashes for every copied file.
|
||||
|
||||
Review the real TCK evidence before expanding the scope:
|
||||
|
||||
```text
|
||||
/tmp/open-cmis-tck-live/normalized/evidence.json
|
||||
/tmp/open-cmis-tck-live/artifacts/open-cmis-tck/tck/<check-group>/console-runner-stdout.txt
|
||||
/tmp/open-cmis-tck-live/artifacts/open-cmis-tck/tck/<check-group>/normalized-runner-result.json
|
||||
/tmp/open-cmis-tck-live/reports/opencmis-log-review.md
|
||||
```
|
||||
|
||||
The normalizer preserves native OpenCMIS statuses (`OK`, `WARNING`, `FAILURE`,
|
||||
|
||||
Reference in New Issue
Block a user