Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

public_revenue

null

2026-02-23T06:14:05.382552

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies public revenue as government funds collected through taxation and other means for public expenditures. It's precise and non-circular, though it could be slightly more specific about what constitutes "other means" beyond taxation.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 5, where he explicitly examines how government policies like bounties and trade restrictions affect public revenue and impose tax burdens on the population. The context accurately reflects Smith's concerns about these fiscal impacts.

name	value	max_value	rationale
domain_placement	3.0	5.0	While public revenue relates to distribution of resources, it's more fundamentally a matter of government finance and fiscal policy. It might be better categorized under "Government" or "Public Finance" rather than "Distribution," as it deals with revenue collection mechanisms rather than distributive outcomes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Public revenue maps well to S3 (internal regulation/audit) as it represents the resource collection function that enables government operations, and potentially to S5 (identity/policy) as revenue decisions reflect fundamental choices about government scope and priorities. It has clear VSM relevance for understanding system viability.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the fiscal mechanisms underlying Smith's critique of mercantile policies. It reveals how trade restrictions create a structural tension between special interest benefits and public fiscal burden, which is central to Smith's economic argument.

Evaluation: Public Revenue

definition_precision — 4.0 / 5.0

The definition clearly identifies public revenue as government funds collected through taxation and other means for public expenditures. It's precise and non-circular, though it could be slightly more specific about what constitutes "other means" beyond taxation.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 5, where he explicitly examines how government policies like bounties and trade restrictions affect public revenue and impose tax burdens on the population. The context accurately reflects Smith's concerns about these fiscal impacts.

domain_placement — 3.0 / 5.0

While public revenue relates to distribution of resources, it's more fundamentally a matter of government finance and fiscal policy. It might be better categorized under "Government" or "Public Finance" rather than "Distribution," as it deals with revenue collection mechanisms rather than distributive outcomes.

vsm_relevance — 4.0 / 5.0

Public revenue maps well to S3 (internal regulation/audit) as it represents the resource collection function that enables government operations, and potentially to S5 (identity/policy) as revenue decisions reflect fundamental choices about government scope and priorities. It has clear VSM relevance for understanding system viability.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the fiscal mechanisms underlying Smith's critique of mercantile policies. It reveals how trade restrictions create a structural tension between special interest benefits and public fiscal burden, which is central to Smith's economic argument.

3.7 KiB Raw Blame History