Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

public_bank_revenue

null

2026-02-23T06:12:05.729686

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying the precise revenue streams (interest differentials, management fees, banking profits) that constitute public bank revenue. It avoids circularity and captures a distinct financial concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion of public banks in Hamburg, Venice, and Amsterdam in Book V, Chapter 2. Smith explicitly analyzes how these institutions generated revenue for their respective governments through banking operations.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "General Theory" domain placement is appropriate as this concept relates to Smith's broader theoretical framework about public finance and revenue sources. It fits well within his systematic analysis of different methods by which sovereigns can generate income.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as a specific revenue-generating activity of government. It could also relate to S3 (internal regulation) regarding the management and oversight requirements Smith mentions for successful public banking.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory value by illuminating a specific mechanism through which governments can generate revenue beyond traditional taxation. It reveals the structural relationship between public banking operations and sovereign finance that Smith identified as historically significant.

Evaluation: Public Bank Revenue

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying the precise revenue streams (interest differentials, management fees, banking profits) that constitute public bank revenue. It avoids circularity and captures a distinct financial concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion of public banks in Hamburg, Venice, and Amsterdam in Book V, Chapter 2. Smith explicitly analyzes how these institutions generated revenue for their respective governments through banking operations.

domain_placement — 4.0 / 5.0

The "General Theory" domain placement is appropriate as this concept relates to Smith's broader theoretical framework about public finance and revenue sources. It fits well within his systematic analysis of different methods by which sovereigns can generate income.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as a specific revenue-generating activity of government. It could also relate to S3 (internal regulation) regarding the management and oversight requirements Smith mentions for successful public banking.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory value by illuminating a specific mechanism through which governments can generate revenue beyond traditional taxation. It reveals the structural relationship between public banking operations and sovereign finance that Smith identified as historically significant.

3.4 KiB Raw Blame History