feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_economic_resilience
evaluator: null
evaluated_at: '2026-02-23T00:39:56.037611'
overall_score: 3.2
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about banking system stability,
but uses somewhat circular language ("resilient banking systems" in the definition
of resilience). The core idea of withstanding economic shocks while maintaining
functions is reasonably precise.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss banking in Book II, Chapter 2, the modern concept
of "economic resilience" and systematic analysis of banking systems' shock absorption
capabilities is not clearly present in his 18th-century text. This appears to
impose contemporary banking theory onto Smith's more basic observations about
banks.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Regulation" domain assignment is appropriate since banking resilience
is fundamentally about regulatory frameworks and institutional design that enable
stability. This fits well within economic governance and oversight concepts.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation/audit) as it concerns
the regulatory mechanisms that maintain banking system stability, and potentially
S2 (coordination/anti-oscillation) regarding system-wide stability mechanisms.
It has clear VSM relevance for organizational viability.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: The concept does illuminate important structural relations about how
banking systems maintain stability, but it remains somewhat abstract without specifying
the particular mechanisms that create resilience. It names an important phenomenon
but could be more mechanistically precise.
---
# Evaluation: Bank Economic Resilience
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about banking system stability, but uses somewhat circular language ("resilient banking systems" in the definition of resilience). The core idea of withstanding economic shocks while maintaining functions is reasonably precise.
## source_grounding — 2.0 / 5.0
While Smith does discuss banking in Book II, Chapter 2, the modern concept of "economic resilience" and systematic analysis of banking systems' shock absorption capabilities is not clearly present in his 18th-century text. This appears to impose contemporary banking theory onto Smith's more basic observations about banks.
## domain_placement — 4.0 / 5.0
The "Regulation" domain assignment is appropriate since banking resilience is fundamentally about regulatory frameworks and institutional design that enable stability. This fits well within economic governance and oversight concepts.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation/audit) as it concerns the regulatory mechanisms that maintain banking system stability, and potentially S2 (coordination/anti-oscillation) regarding system-wide stability mechanisms. It has clear VSM relevance for organizational viability.
## explanatory_value — 3.0 / 5.0
The concept does illuminate important structural relations about how banking systems maintain stability, but it remains somewhat abstract without specifying the particular mechanisms that create resilience. It names an important phenomenon but could be more mechanistically precise.