Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_financial_innovation_adoption

null

2026-02-23T00:40:32.769386

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about how banking innovations spread through the system, but it's somewhat vague about what constitutes "adoption" and lacks specificity about the mechanisms involved. The concept is non-circular but could be more precise about the actual process.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss banking innovations and their effects in Book II, Chapter 2, the specific framing of "adoption rates and patterns" as a systematic process appears to impose modern diffusion theory concepts onto Smith's text. Smith focuses more on the innovations themselves rather than their adoption dynamics.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Accumulation" domain is appropriate since banking innovations directly relate to capital formation and the efficiency of investment processes that Smith discusses in Book II. This fits well within his analysis of how capital accumulation drives economic growth.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how the banking system adapts to and incorporates new practices, and potentially S2 (coordination) as adoption involves coordinating new practices across institutions. The concept has clear VSM relevance.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The entity provides moderate explanatory value by highlighting how the spread of innovations affects their economic impact, but it focuses more on describing a process rather than illuminating the underlying mechanisms that Smith actually analyzes. It adds some insight but remains somewhat surface-level.

Evaluation: Bank Financial Innovation Adoption

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about how banking innovations spread through the system, but it's somewhat vague about what constitutes "adoption" and lacks specificity about the mechanisms involved. The concept is non-circular but could be more precise about the actual process.

source_grounding — 2.0 / 5.0

While Smith does discuss banking innovations and their effects in Book II, Chapter 2, the specific framing of "adoption rates and patterns" as a systematic process appears to impose modern diffusion theory concepts onto Smith's text. Smith focuses more on the innovations themselves rather than their adoption dynamics.

domain_placement — 4.0 / 5.0

The "Accumulation" domain is appropriate since banking innovations directly relate to capital formation and the efficiency of investment processes that Smith discusses in Book II. This fits well within his analysis of how capital accumulation drives economic growth.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how the banking system adapts to and incorporates new practices, and potentially S2 (coordination) as adoption involves coordinating new practices across institutions. The concept has clear VSM relevance.

explanatory_value — 3.0 / 5.0

The entity provides moderate explanatory value by highlighting how the spread of innovations affects their economic impact, but it focuses more on describing a process rather than illuminating the underlying mechanisms that Smith actually analyzes. It adds some insight but remains somewhat surface-level.

3.6 KiB Raw Blame History