Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_economic_cycles

null

2026-02-23T00:38:33.381441

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a recognizable economic phenomenon but remains somewhat vague with terms like "recurring patterns" and "careful management." It identifies the core concept of cyclical banking activity but lacks specificity about the mechanisms or characteristics that define these cycles.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does analyze banking cycles in Book II, Chapter 2, particularly discussing how banks' lending practices create periods of expansion followed by contraction when overtrading occurs. The entity accurately reflects Smith's observations about the cyclical nature of banking and its economic effects.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents a broad theoretical framework about how banking systems operate cyclically within the economy. It's not specific to particular banking operations but rather describes systemic patterns.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as it directly concerns the oscillatory behavior of banking systems and their need for regulation to prevent excessive swings. It also has relevance to S4 (intelligence) regarding monitoring economic conditions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying a structural mechanism in Smith's economic theory - how banking activity creates self-reinforcing cycles that affect the broader economy. This goes beyond surface description to illuminate systemic relationships between banking and economic development.

Evaluation: Bank Economic Cycles

definition_precision — 3.0 / 5.0

The definition captures a recognizable economic phenomenon but remains somewhat vague with terms like "recurring patterns" and "careful management." It identifies the core concept of cyclical banking activity but lacks specificity about the mechanisms or characteristics that define these cycles.

source_grounding — 4.0 / 5.0

Smith does analyze banking cycles in Book II, Chapter 2, particularly discussing how banks' lending practices create periods of expansion followed by contraction when overtrading occurs. The entity accurately reflects Smith's observations about the cyclical nature of banking and its economic effects.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents a broad theoretical framework about how banking systems operate cyclically within the economy. It's not specific to particular banking operations but rather describes systemic patterns.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as it directly concerns the oscillatory behavior of banking systems and their need for regulation to prevent excessive swings. It also has relevance to S4 (intelligence) regarding monitoring economic conditions.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying a structural mechanism in Smith's economic theory - how banking activity creates self-reinforcing cycles that affect the broader economy. This goes beyond surface description to illuminate systemic relationships between banking and economic development.

3.6 KiB Raw Blame History