Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

certainty_in_taxation

null

2026-02-23T04:42:22.672111

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly distinguishing certainty from other tax principles by focusing specifically on clarity of amount, timing, and manner of payment. It captures a distinct concept that is operationally meaningful and measurable.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit second maxim of taxation from Book V, Chapter 2, where he specifically discusses the importance of certainty in tax obligations. The definition accurately reflects Smith's own articulation of this principle without introducing foreign concepts.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this represents one of Smith's foundational theoretical principles for taxation policy. It belongs in the theoretical framework rather than in applied or institutional categories.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as it concerns systematic control mechanisms that prevent arbitrary assessment and corruption within the tax system. It also has relevance to S2 (coordination) by reducing oscillations caused by uncertain tax obligations.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism through which clear tax rules prevent corruption and arbitrary government action. It explains how procedural clarity creates systemic stability rather than merely naming a desirable feature.

Evaluation: Certainty In Taxation

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly distinguishing certainty from other tax principles by focusing specifically on clarity of amount, timing, and manner of payment. It captures a distinct concept that is operationally meaningful and measurable.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit second maxim of taxation from Book V, Chapter 2, where he specifically discusses the importance of certainty in tax obligations. The definition accurately reflects Smith's own articulation of this principle without introducing foreign concepts.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this represents one of Smith's foundational theoretical principles for taxation policy. It belongs in the theoretical framework rather than in applied or institutional categories.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as it concerns systematic control mechanisms that prevent arbitrary assessment and corruption within the tax system. It also has relevance to S2 (coordination) by reducing oscillations caused by uncertain tax obligations.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism through which clear tax rules prevent corruption and arbitrary government action. It explains how procedural clarity creates systemic stability rather than merely naming a desirable feature.

3.4 KiB Raw Blame History