feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: public_bank_revenue
evaluator: null
evaluated_at: '2026-02-23T06:12:05.729686'
overall_score: 4.0
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is clear and specific, identifying the precise revenue
streams (interest differentials, management fees, banking profits) that constitute
public bank revenue. It avoids circularity and captures a distinct financial concept
rather than a vague umbrella term.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual discussion of public banks
in Hamburg, Venice, and Amsterdam in Book V, Chapter 2. Smith explicitly analyzes
how these institutions generated revenue for their respective governments through
banking operations.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "General Theory" domain placement is appropriate as this concept
relates to Smith's broader theoretical framework about public finance and revenue
sources. It fits well within his systematic analysis of different methods by which
sovereigns can generate income.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S1 (primary
operations) as a specific revenue-generating activity of government. It could
also relate to S3 (internal regulation) regarding the management and oversight
requirements Smith mentions for successful public banking.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory value by illuminating a specific
mechanism through which governments can generate revenue beyond traditional taxation.
It reveals the structural relationship between public banking operations and sovereign
finance that Smith identified as historically significant.
---
# Evaluation: Public Bank Revenue
## definition_precision — 4.0 / 5.0
The definition is clear and specific, identifying the precise revenue streams (interest differentials, management fees, banking profits) that constitute public bank revenue. It avoids circularity and captures a distinct financial concept rather than a vague umbrella term.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual discussion of public banks in Hamburg, Venice, and Amsterdam in Book V, Chapter 2. Smith explicitly analyzes how these institutions generated revenue for their respective governments through banking operations.
## domain_placement — 4.0 / 5.0
The "General Theory" domain placement is appropriate as this concept relates to Smith's broader theoretical framework about public finance and revenue sources. It fits well within his systematic analysis of different methods by which sovereigns can generate income.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as a specific revenue-generating activity of government. It could also relate to S3 (internal regulation) regarding the management and oversight requirements Smith mentions for successful public banking.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory value by illuminating a specific mechanism through which governments can generate revenue beyond traditional taxation. It reveals the structural relationship between public banking operations and sovereign finance that Smith identified as historically significant.