feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_economic_cycles
evaluator: null
evaluated_at: '2026-02-23T00:38:33.381441'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a recognizable economic phenomenon but remains
somewhat vague with terms like "recurring patterns" and "careful management."
It identifies the core concept of cyclical banking activity but lacks specificity
about the mechanisms or characteristics that define these cycles.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does analyze banking cycles in Book II, Chapter 2, particularly
discussing how banks' lending practices create periods of expansion followed by
contraction when overtrading occurs. The entity accurately reflects Smith's observations
about the cyclical nature of banking and its economic effects.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this concept
represents a broad theoretical framework about how banking systems operate cyclically
within the economy. It''s not specific to particular banking operations but rather
describes systemic patterns.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S2 (coordination/anti-oscillation) as it directly
concerns the oscillatory behavior of banking systems and their need for regulation
to prevent excessive swings. It also has relevance to S4 (intelligence) regarding
monitoring economic conditions.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by identifying a structural
mechanism in Smith's economic theory - how banking activity creates self-reinforcing
cycles that affect the broader economy. This goes beyond surface description to
illuminate systemic relationships between banking and economic development.
---
# Evaluation: Bank Economic Cycles
## definition_precision — 3.0 / 5.0
The definition captures a recognizable economic phenomenon but remains somewhat vague with terms like "recurring patterns" and "careful management." It identifies the core concept of cyclical banking activity but lacks specificity about the mechanisms or characteristics that define these cycles.
## source_grounding — 4.0 / 5.0
Smith does analyze banking cycles in Book II, Chapter 2, particularly discussing how banks' lending practices create periods of expansion followed by contraction when overtrading occurs. The entity accurately reflects Smith's observations about the cyclical nature of banking and its economic effects.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this concept represents a broad theoretical framework about how banking systems operate cyclically within the economy. It's not specific to particular banking operations but rather describes systemic patterns.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S2 (coordination/anti-oscillation) as it directly concerns the oscillatory behavior of banking systems and their need for regulation to prevent excessive swings. It also has relevance to S4 (intelligence) regarding monitoring economic conditions.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by identifying a structural mechanism in Smith's economic theory - how banking activity creates self-reinforcing cycles that affect the broader economy. This goes beyond surface description to illuminate systemic relationships between banking and economic development.