Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

equality_in_taxation

null

2026-02-23T05:24:00.647799

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures Smith's principle of proportional taxation based on ability to pay, avoiding circularity and distinguishing it from other tax concepts. It could be slightly more precise about what "ability to pay" means in practice, but the core concept is well-defined.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's first maxim of taxation from Book V, Chapter 2, where he explicitly states that subjects should contribute to public expenses "as nearly as possible, in proportion to their respective abilities." The concept is clearly and prominently articulated in the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this represents a fundamental theoretical principle of Smith's tax philosophy rather than a specific mechanism or historical observation. It belongs in the foundational conceptual framework of his economic theory.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S5 (identity/policy) as it represents a core policy principle that defines the identity and values of a viable economic system. It also has some relevance to S3 (internal regulation) as it guides how the system should regulate resource extraction from its components.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating Smith's underlying philosophy about fair resource distribution and social stability through proportional contribution. It reveals the structural relationship between individual capacity, state protection, and fiscal obligation rather than merely naming a surface phenomenon.

Evaluation: Equality In Taxation

definition_precision — 4.0 / 5.0

The definition clearly captures Smith's principle of proportional taxation based on ability to pay, avoiding circularity and distinguishing it from other tax concepts. It could be slightly more precise about what "ability to pay" means in practice, but the core concept is well-defined.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's first maxim of taxation from Book V, Chapter 2, where he explicitly states that subjects should contribute to public expenses "as nearly as possible, in proportion to their respective abilities." The concept is clearly and prominently articulated in the source text.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this represents a fundamental theoretical principle of Smith's tax philosophy rather than a specific mechanism or historical observation. It belongs in the foundational conceptual framework of his economic theory.

vsm_relevance — 4.0 / 5.0

This entity maps well to S5 (identity/policy) as it represents a core policy principle that defines the identity and values of a viable economic system. It also has some relevance to S3 (internal regulation) as it guides how the system should regulate resource extraction from its components.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating Smith's underlying philosophy about fair resource distribution and social stability through proportional contribution. It reveals the structural relationship between individual capacity, state protection, and fiscal obligation rather than merely naming a surface phenomenon.

3.7 KiB Raw Blame History