feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: equality_in_taxation
evaluator: null
evaluated_at: '2026-02-23T05:24:00.647799'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures Smith's principle of proportional taxation
based on ability to pay, avoiding circularity and distinguishing it from other
tax concepts. It could be slightly more precise about what "ability to pay" means
in practice, but the core concept is well-defined.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity directly reflects Smith's first maxim of taxation from Book
V, Chapter 2, where he explicitly states that subjects should contribute to public
expenses "as nearly as possible, in proportion to their respective abilities."
The concept is clearly and prominently articulated in the source text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement since this represents
a fundamental theoretical principle of Smith''s tax philosophy rather than a specific
mechanism or historical observation. It belongs in the foundational conceptual
framework of his economic theory.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S5 (identity/policy) as it represents a core
policy principle that defines the identity and values of a viable economic system.
It also has some relevance to S3 (internal regulation) as it guides how the system
should regulate resource extraction from its components.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating Smith's
underlying philosophy about fair resource distribution and social stability through
proportional contribution. It reveals the structural relationship between individual
capacity, state protection, and fiscal obligation rather than merely naming a
surface phenomenon.
---
# Evaluation: Equality In Taxation
## definition_precision — 4.0 / 5.0
The definition clearly captures Smith's principle of proportional taxation based on ability to pay, avoiding circularity and distinguishing it from other tax concepts. It could be slightly more precise about what "ability to pay" means in practice, but the core concept is well-defined.
## source_grounding — 5.0 / 5.0
This entity directly reflects Smith's first maxim of taxation from Book V, Chapter 2, where he explicitly states that subjects should contribute to public expenses "as nearly as possible, in proportion to their respective abilities." The concept is clearly and prominently articulated in the source text.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement since this represents a fundamental theoretical principle of Smith's tax philosophy rather than a specific mechanism or historical observation. It belongs in the foundational conceptual framework of his economic theory.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S5 (identity/policy) as it represents a core policy principle that defines the identity and values of a viable economic system. It also has some relevance to S3 (internal regulation) as it guides how the system should regulate resource extraction from its components.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating Smith's underlying philosophy about fair resource distribution and social stability through proportional contribution. It reveals the structural relationship between individual capacity, state protection, and fiscal obligation rather than merely naming a surface phenomenon.