Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_regulatory_evolution

null

2026-02-23T00:49:20.745463

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept of regulatory development over time, but uses somewhat vague terms like "minimal formal rules" and "comprehensive frameworks" without clear boundaries. The concept is distinct but could be more precisely delineated.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does indeed analyze the historical development of banking practices and their regulation in Book II, Chapter 2, examining how banking evolved in response to various pressures and crises. The entity accurately reflects his historical approach to understanding banking regulation.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the appropriate domain for this entity, as it directly concerns the development of regulatory frameworks governing banking institutions. This clearly falls within regulatory rather than operational or market domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as it concerns regulatory mechanisms, and also connects to S4 (intelligence/environmental adaptation) since regulatory evolution represents adaptive responses to environmental changes and crises. The evolutionary aspect shows clear VSM system interactions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural mechanism - how regulatory frameworks adapt and develop in response to systemic pressures and failures. This provides genuine insight into the dynamic relationship between banking practice and regulatory oversight rather than merely describing surface phenomena.

Evaluation: Bank Regulatory Evolution

definition_precision — 3.0 / 5.0

The definition captures a coherent concept of regulatory development over time, but uses somewhat vague terms like "minimal formal rules" and "comprehensive frameworks" without clear boundaries. The concept is distinct but could be more precisely delineated.

source_grounding — 4.0 / 5.0

Smith does indeed analyze the historical development of banking practices and their regulation in Book II, Chapter 2, examining how banking evolved in response to various pressures and crises. The entity accurately reflects his historical approach to understanding banking regulation.

domain_placement — 5.0 / 5.0

"Regulation" is the appropriate domain for this entity, as it directly concerns the development of regulatory frameworks governing banking institutions. This clearly falls within regulatory rather than operational or market domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as it concerns regulatory mechanisms, and also connects to S4 (intelligence/environmental adaptation) since regulatory evolution represents adaptive responses to environmental changes and crises. The evolutionary aspect shows clear VSM system interactions.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural mechanism - how regulatory frameworks adapt and develop in response to systemic pressures and failures. This provides genuine insight into the dynamic relationship between banking practice and regulatory oversight rather than merely describing surface phenomena.

3.5 KiB Raw Blame History