feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: bank_regulatory_evolution
evaluator: null
evaluated_at: '2026-02-23T00:49:20.745463'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept of regulatory development
over time, but uses somewhat vague terms like "minimal formal rules" and "comprehensive
frameworks" without clear boundaries. The concept is distinct but could be more
precisely delineated.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does indeed analyze the historical development of banking practices
and their regulation in Book II, Chapter 2, examining how banking evolved in response
to various pressures and crises. The entity accurately reflects his historical
approach to understanding banking regulation.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the appropriate domain for this entity, as it directly
concerns the development of regulatory frameworks governing banking institutions.
This clearly falls within regulatory rather than operational or market domains.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation/audit) as it concerns
regulatory mechanisms, and also connects to S4 (intelligence/environmental adaptation)
since regulatory evolution represents adaptive responses to environmental changes
and crises. The evolutionary aspect shows clear VSM system interactions.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important structural mechanism - how regulatory
frameworks adapt and develop in response to systemic pressures and failures. This
provides genuine insight into the dynamic relationship between banking practice
and regulatory oversight rather than merely describing surface phenomena.
---
# Evaluation: Bank Regulatory Evolution
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept of regulatory development over time, but uses somewhat vague terms like "minimal formal rules" and "comprehensive frameworks" without clear boundaries. The concept is distinct but could be more precisely delineated.
## source_grounding — 4.0 / 5.0
Smith does indeed analyze the historical development of banking practices and their regulation in Book II, Chapter 2, examining how banking evolved in response to various pressures and crises. The entity accurately reflects his historical approach to understanding banking regulation.
## domain_placement — 5.0 / 5.0
"Regulation" is the appropriate domain for this entity, as it directly concerns the development of regulatory frameworks governing banking institutions. This clearly falls within regulatory rather than operational or market domains.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation/audit) as it concerns regulatory mechanisms, and also connects to S4 (intelligence/environmental adaptation) since regulatory evolution represents adaptive responses to environmental changes and crises. The evolutionary aspect shows clear VSM system interactions.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important structural mechanism - how regulatory frameworks adapt and develop in response to systemic pressures and failures. This provides genuine insight into the dynamic relationship between banking practice and regulatory oversight rather than merely describing surface phenomena.