Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_financial_innovation_impact

null

2026-02-23T00:40:58.526861

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about banking innovation effects, but uses somewhat vague terms like "significantly enhance" and "potentially destabilise" without clear criteria. It could be more precise about what constitutes financial innovation and how impacts are measured.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does analyze banking innovations and their economic effects in Book II, Chapter 2, particularly discussing how new banking practices affect capital circulation and economic development. The entity appears well-grounded in his actual discussion of banking evolution and its consequences.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Accumulation" domain is perfectly appropriate since banking innovations directly affect capital formation, circulation, and the accumulation process that Smith analyzes in Book II. This is clearly an accumulation-related phenomenon rather than production or distribution.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as banking innovations represent adaptive responses to environmental changes and new intelligence about financial practices. It also has some S2 relevance regarding coordination mechanisms in the financial system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism by which banking systems evolve and affect broader economic development, going beyond surface description to capture how innovations create structural changes. It helps explain the dynamic relationship between financial sector evolution and economic growth.

Evaluation: Bank Financial Innovation Impact

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about banking innovation effects, but uses somewhat vague terms like "significantly enhance" and "potentially destabilise" without clear criteria. It could be more precise about what constitutes financial innovation and how impacts are measured.

source_grounding — 4.0 / 5.0

Smith does analyze banking innovations and their economic effects in Book II, Chapter 2, particularly discussing how new banking practices affect capital circulation and economic development. The entity appears well-grounded in his actual discussion of banking evolution and its consequences.

domain_placement — 5.0 / 5.0

The "Accumulation" domain is perfectly appropriate since banking innovations directly affect capital formation, circulation, and the accumulation process that Smith analyzes in Book II. This is clearly an accumulation-related phenomenon rather than production or distribution.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as banking innovations represent adaptive responses to environmental changes and new intelligence about financial practices. It also has some S2 relevance regarding coordination mechanisms in the financial system.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism by which banking systems evolve and affect broader economic development, going beyond surface description to capture how innovations create structural changes. It helps explain the dynamic relationship between financial sector evolution and economic growth.

3.6 KiB Raw Blame History