feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_operational_efficiency
evaluator: null
evaluated_at: '2026-02-23T00:48:38.165254'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept around banking efficiency
but remains somewhat broad, encompassing multiple operational aspects (note issuance,
lending, reserves) without clearly delineating the boundaries. While not circular,
it could be more precise about what constitutes "effectiveness" in banking operations.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual analysis of banking operations
in Book II, Chapter 2, where he extensively discusses how banks should manage
their operations, including note circulation, lending practices, and reserve management.
The concept directly reflects Smith's concerns about prudent banking practices.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The placement in the "Accumulation" domain is highly appropriate, as
banking efficiency directly relates to capital formation and the accumulation
process that Smith analyzes in Book II. Banks facilitate accumulation through
their operational decisions about lending and money supply.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to VSM System 3 (internal regulation/audit) as
it concerns how banks internally manage their operations for optimal performance.
It also has elements of S1 (primary operations) regarding the actual banking functions
being optimized.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by identifying the mechanisms
through which banking operations affect broader economic outcomes. It illuminates
the structural relationship between internal bank management and economic efficiency
rather than merely describing surface phenomena.
---
# Evaluation: Bank Operational Efficiency
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept around banking efficiency but remains somewhat broad, encompassing multiple operational aspects (note issuance, lending, reserves) without clearly delineating the boundaries. While not circular, it could be more precise about what constitutes "effectiveness" in banking operations.
## source_grounding — 4.0 / 5.0
This entity is well-grounded in Smith's actual analysis of banking operations in Book II, Chapter 2, where he extensively discusses how banks should manage their operations, including note circulation, lending practices, and reserve management. The concept directly reflects Smith's concerns about prudent banking practices.
## domain_placement — 5.0 / 5.0
The placement in the "Accumulation" domain is highly appropriate, as banking efficiency directly relates to capital formation and the accumulation process that Smith analyzes in Book II. Banks facilitate accumulation through their operational decisions about lending and money supply.
## vsm_relevance — 4.0 / 5.0
This entity maps well to VSM System 3 (internal regulation/audit) as it concerns how banks internally manage their operations for optimal performance. It also has elements of S1 (primary operations) regarding the actual banking functions being optimized.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by identifying the mechanisms through which banking operations affect broader economic outcomes. It illuminates the structural relationship between internal bank management and economic efficiency rather than merely describing surface phenomena.