feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: sovereign_revenue_sources
evaluator: null
evaluated_at: '2026-02-23T06:23:25.216249'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes sovereign revenue sources from taxes
by emphasizing independence from the general population and direct state management.
It provides specific examples (stock, land, commercial enterprises) that make
the concept concrete and operationally distinct.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's explicit categorization in
Book V, Chapter 2, where he systematically distinguishes sovereign revenue sources
as the first type of public revenue. The examples cited (public banks, post offices,
crown lands) are specifically discussed by Smith in this context.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this represents
Smith''s fundamental theoretical framework for categorizing public finance mechanisms.
This is a foundational conceptual distinction rather than a specific policy application.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S1 (primary
operations) as these represent direct operational revenue-generating activities
of the state. However, it could also touch on S3 (internal regulation) regarding
how the state manages its own resources, making the VSM placement somewhat ambiguous.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides significant explanatory value by illuminating Smith's
structural approach to public finance and the mechanism by which states can achieve
fiscal independence. It reveals an important theoretical distinction that underlies
Smith's broader analysis of government finance and sustainability.
---
# Evaluation: Sovereign Revenue Sources
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes sovereign revenue sources from taxes by emphasizing independence from the general population and direct state management. It provides specific examples (stock, land, commercial enterprises) that make the concept concrete and operationally distinct.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's explicit categorization in Book V, Chapter 2, where he systematically distinguishes sovereign revenue sources as the first type of public revenue. The examples cited (public banks, post offices, crown lands) are specifically discussed by Smith in this context.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this represents Smith's fundamental theoretical framework for categorizing public finance mechanisms. This is a foundational conceptual distinction rather than a specific policy application.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as these represent direct operational revenue-generating activities of the state. However, it could also touch on S3 (internal regulation) regarding how the state manages its own resources, making the VSM placement somewhat ambiguous.
## explanatory_value — 4.0 / 5.0
This entity provides significant explanatory value by illuminating Smith's structural approach to public finance and the mechanism by which states can achieve fiscal independence. It reveals an important theoretical distinction that underlies Smith's broader analysis of government finance and sustainability.