Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_economic_development

null

2026-02-23T00:38:50.788748

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies three specific mechanisms (efficient capital allocation, reduced transaction costs, conversion of dead stock to productive capital) rather than using vague terms. It avoids circularity by explaining how banking contributes to development rather than simply stating that it does.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book II, Chapter 2, where he explicitly discusses how banks make capital more productive and facilitate commerce. The specific mechanisms mentioned (dead stock conversion, transaction cost reduction) are core themes in Smith's treatment of banking.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Accumulation" domain is highly appropriate since this entity describes how banking enhances the accumulation and productive deployment of capital. This aligns perfectly with Book II's focus on the nature and accumulation of stock.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations of capital allocation) and S4 (intelligence function in identifying productive investment opportunities). The coordination and efficiency aspects also suggest relevance to S2's anti-oscillation functions in smoothing economic flows.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by identifying the specific structural mechanisms through which banking contributes to economic growth. It illuminates the functional relationship between financial intermediation and wealth creation rather than merely describing surface phenomena.

Evaluation: Bank Economic Development

definition_precision — 4.0 / 5.0

The definition clearly identifies three specific mechanisms (efficient capital allocation, reduced transaction costs, conversion of dead stock to productive capital) rather than using vague terms. It avoids circularity by explaining how banking contributes to development rather than simply stating that it does.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book II, Chapter 2, where he explicitly discusses how banks make capital more productive and facilitate commerce. The specific mechanisms mentioned (dead stock conversion, transaction cost reduction) are core themes in Smith's treatment of banking.

domain_placement — 5.0 / 5.0

Placement in the "Accumulation" domain is highly appropriate since this entity describes how banking enhances the accumulation and productive deployment of capital. This aligns perfectly with Book II's focus on the nature and accumulation of stock.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations of capital allocation) and S4 (intelligence function in identifying productive investment opportunities). The coordination and efficiency aspects also suggest relevance to S2's anti-oscillation functions in smoothing economic flows.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by identifying the specific structural mechanisms through which banking contributes to economic growth. It illuminates the functional relationship between financial intermediation and wealth creation rather than merely describing surface phenomena.

3.6 KiB Raw Blame History