Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_economic_resilience

null

2026-02-23T00:39:56.037611

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about banking system stability, but uses somewhat circular language ("resilient banking systems" in the definition of resilience). The core idea of withstanding economic shocks while maintaining functions is reasonably precise.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss banking in Book II, Chapter 2, the modern concept of "economic resilience" and systematic analysis of banking systems' shock absorption capabilities is not clearly present in his 18th-century text. This appears to impose contemporary banking theory onto Smith's more basic observations about banks.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain assignment is appropriate since banking resilience is fundamentally about regulatory frameworks and institutional design that enable stability. This fits well within economic governance and oversight concepts.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as it concerns the regulatory mechanisms that maintain banking system stability, and potentially S2 (coordination/anti-oscillation) regarding system-wide stability mechanisms. It has clear VSM relevance for organizational viability.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The concept does illuminate important structural relations about how banking systems maintain stability, but it remains somewhat abstract without specifying the particular mechanisms that create resilience. It names an important phenomenon but could be more mechanistically precise.

Evaluation: Bank Economic Resilience

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about banking system stability, but uses somewhat circular language ("resilient banking systems" in the definition of resilience). The core idea of withstanding economic shocks while maintaining functions is reasonably precise.

source_grounding — 2.0 / 5.0

While Smith does discuss banking in Book II, Chapter 2, the modern concept of "economic resilience" and systematic analysis of banking systems' shock absorption capabilities is not clearly present in his 18th-century text. This appears to impose contemporary banking theory onto Smith's more basic observations about banks.

domain_placement — 4.0 / 5.0

The "Regulation" domain assignment is appropriate since banking resilience is fundamentally about regulatory frameworks and institutional design that enable stability. This fits well within economic governance and oversight concepts.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as it concerns the regulatory mechanisms that maintain banking system stability, and potentially S2 (coordination/anti-oscillation) regarding system-wide stability mechanisms. It has clear VSM relevance for organizational viability.

explanatory_value — 3.0 / 5.0

The concept does illuminate important structural relations about how banking systems maintain stability, but it remains somewhat abstract without specifying the particular mechanisms that create resilience. It names an important phenomenon but could be more mechanistically precise.

3.5 KiB Raw Blame History