Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

sovereign_revenue_sources

null

2026-02-23T06:23:25.216249

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes sovereign revenue sources from taxes by emphasizing independence from the general population and direct state management. It provides specific examples (stock, land, commercial enterprises) that make the concept concrete and operationally distinct.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit categorization in Book V, Chapter 2, where he systematically distinguishes sovereign revenue sources as the first type of public revenue. The examples cited (public banks, post offices, crown lands) are specifically discussed by Smith in this context.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this represents Smith's fundamental theoretical framework for categorizing public finance mechanisms. This is a foundational conceptual distinction rather than a specific policy application.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as these represent direct operational revenue-generating activities of the state. However, it could also touch on S3 (internal regulation) regarding how the state manages its own resources, making the VSM placement somewhat ambiguous.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating Smith's structural approach to public finance and the mechanism by which states can achieve fiscal independence. It reveals an important theoretical distinction that underlies Smith's broader analysis of government finance and sustainability.

Evaluation: Sovereign Revenue Sources

definition_precision — 4.0 / 5.0

The definition clearly distinguishes sovereign revenue sources from taxes by emphasizing independence from the general population and direct state management. It provides specific examples (stock, land, commercial enterprises) that make the concept concrete and operationally distinct.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit categorization in Book V, Chapter 2, where he systematically distinguishes sovereign revenue sources as the first type of public revenue. The examples cited (public banks, post offices, crown lands) are specifically discussed by Smith in this context.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this represents Smith's fundamental theoretical framework for categorizing public finance mechanisms. This is a foundational conceptual distinction rather than a specific policy application.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as these represent direct operational revenue-generating activities of the state. However, it could also touch on S3 (internal regulation) regarding how the state manages its own resources, making the VSM placement somewhat ambiguous.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating Smith's structural approach to public finance and the mechanism by which states can achieve fiscal independence. It reveals an important theoretical distinction that underlies Smith's broader analysis of government finance and sustainability.

3.6 KiB Raw Blame History