Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_operational_efficiency

null

2026-02-23T00:48:38.165254

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept around banking efficiency but remains somewhat broad, encompassing multiple operational aspects (note issuance, lending, reserves) without clearly delineating the boundaries. While not circular, it could be more precise about what constitutes "effectiveness" in banking operations.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual analysis of banking operations in Book II, Chapter 2, where he extensively discusses how banks should manage their operations, including note circulation, lending practices, and reserve management. The concept directly reflects Smith's concerns about prudent banking practices.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in the "Accumulation" domain is highly appropriate, as banking efficiency directly relates to capital formation and the accumulation process that Smith analyzes in Book II. Banks facilitate accumulation through their operational decisions about lending and money supply.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 3 (internal regulation/audit) as it concerns how banks internally manage their operations for optimal performance. It also has elements of S1 (primary operations) regarding the actual banking functions being optimized.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying the mechanisms through which banking operations affect broader economic outcomes. It illuminates the structural relationship between internal bank management and economic efficiency rather than merely describing surface phenomena.

Evaluation: Bank Operational Efficiency

definition_precision — 3.0 / 5.0

The definition captures a coherent concept around banking efficiency but remains somewhat broad, encompassing multiple operational aspects (note issuance, lending, reserves) without clearly delineating the boundaries. While not circular, it could be more precise about what constitutes "effectiveness" in banking operations.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual analysis of banking operations in Book II, Chapter 2, where he extensively discusses how banks should manage their operations, including note circulation, lending practices, and reserve management. The concept directly reflects Smith's concerns about prudent banking practices.

domain_placement — 5.0 / 5.0

The placement in the "Accumulation" domain is highly appropriate, as banking efficiency directly relates to capital formation and the accumulation process that Smith analyzes in Book II. Banks facilitate accumulation through their operational decisions about lending and money supply.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 3 (internal regulation/audit) as it concerns how banks internally manage their operations for optimal performance. It also has elements of S1 (primary operations) regarding the actual banking functions being optimized.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying the mechanisms through which banking operations affect broader economic outcomes. It illuminates the structural relationship between internal bank management and economic efficiency rather than merely describing surface phenomena.

3.6 KiB Raw Blame History