feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,63 @@
|
||||
---
|
||||
entity_slug: certainty_in_taxation
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T04:42:22.672111'
|
||||
overall_score: 4.8
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The definition is highly precise and non-circular, clearly distinguishing
|
||||
certainty from other tax principles by focusing specifically on clarity of amount,
|
||||
timing, and manner of payment. It captures a distinct concept that is operationally
|
||||
meaningful and measurable.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is directly grounded in Smith's explicit second maxim of
|
||||
taxation from Book V, Chapter 2, where he specifically discusses the importance
|
||||
of certainty in tax obligations. The definition accurately reflects Smith's own
|
||||
articulation of this principle without introducing foreign concepts.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: '"General Theory" is the appropriate domain placement as this represents
|
||||
one of Smith''s foundational theoretical principles for taxation policy. It belongs
|
||||
in the theoretical framework rather than in applied or institutional categories.'
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to S3 (internal regulation/audit) as it concerns
|
||||
systematic control mechanisms that prevent arbitrary assessment and corruption
|
||||
within the tax system. It also has relevance to S2 (coordination) by reducing
|
||||
oscillations caused by uncertain tax obligations.
|
||||
- name: explanatory_value
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides significant explanatory power by illuminating the
|
||||
structural mechanism through which clear tax rules prevent corruption and arbitrary
|
||||
government action. It explains how procedural clarity creates systemic stability
|
||||
rather than merely naming a desirable feature.
|
||||
---
|
||||
|
||||
# Evaluation: Certainty In Taxation
|
||||
|
||||
## definition_precision — 5.0 / 5.0
|
||||
|
||||
The definition is highly precise and non-circular, clearly distinguishing certainty from other tax principles by focusing specifically on clarity of amount, timing, and manner of payment. It captures a distinct concept that is operationally meaningful and measurable.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This entity is directly grounded in Smith's explicit second maxim of taxation from Book V, Chapter 2, where he specifically discusses the importance of certainty in tax obligations. The definition accurately reflects Smith's own articulation of this principle without introducing foreign concepts.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
"General Theory" is the appropriate domain placement as this represents one of Smith's foundational theoretical principles for taxation policy. It belongs in the theoretical framework rather than in applied or institutional categories.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to S3 (internal regulation/audit) as it concerns systematic control mechanisms that prevent arbitrary assessment and corruption within the tax system. It also has relevance to S2 (coordination) by reducing oscillations caused by uncertain tax obligations.
|
||||
|
||||
## explanatory_value — 5.0 / 5.0
|
||||
|
||||
This entity provides significant explanatory power by illuminating the structural mechanism through which clear tax rules prevent corruption and arbitrary government action. It explains how procedural clarity creates systemic stability rather than merely naming a desirable feature.
|
||||
Reference in New Issue
Block a user