Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

excise_duties

null

2026-02-23T05:24:45.699105

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes excise duties from other taxes by specifying they are imposed on domestically produced goods for home consumption, collected by government administration, and focus on articles of general use. This captures the essential characteristics that differentiate excise duties from customs duties or other tax forms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's detailed discussion of excise duties in Book V, Chapter 2, where he extensively analyzes their revenue potential, collection methods, and economic effects. The definition accurately reflects Smith's treatment of excise as a distinct category of taxation with specific characteristics and consequences.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as excise duties represent a fundamental mechanism of public finance that Smith analyzes as part of his broader theoretical framework on taxation. While it could potentially fit under a more specific "Public Finance" domain, it belongs to Smith's general theoretical apparatus for understanding government revenue.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Excise duties map reasonably well to S3 (internal regulation) as a mechanism for resource extraction and control within the economic system, and potentially to S1 as an operational function of government. However, the mapping is not as natural or illuminating as it would be for more structural economic concepts.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by identifying a specific fiscal mechanism that Smith analyzes for its effects on industry, smuggling, and revenue generation. It illuminates how different tax structures create different incentives and administrative challenges, contributing to understanding of the relationship between taxation methods and economic outcomes.

Evaluation: Excise Duties

definition_precision — 4.0 / 5.0

The definition clearly distinguishes excise duties from other taxes by specifying they are imposed on domestically produced goods for home consumption, collected by government administration, and focus on articles of general use. This captures the essential characteristics that differentiate excise duties from customs duties or other tax forms.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's detailed discussion of excise duties in Book V, Chapter 2, where he extensively analyzes their revenue potential, collection methods, and economic effects. The definition accurately reflects Smith's treatment of excise as a distinct category of taxation with specific characteristics and consequences.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as excise duties represent a fundamental mechanism of public finance that Smith analyzes as part of his broader theoretical framework on taxation. While it could potentially fit under a more specific "Public Finance" domain, it belongs to Smith's general theoretical apparatus for understanding government revenue.

vsm_relevance — 3.0 / 5.0

Excise duties map reasonably well to S3 (internal regulation) as a mechanism for resource extraction and control within the economic system, and potentially to S1 as an operational function of government. However, the mapping is not as natural or illuminating as it would be for more structural economic concepts.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by identifying a specific fiscal mechanism that Smith analyzes for its effects on industry, smuggling, and revenue generation. It illuminates how different tax structures create different incentives and administrative challenges, contributing to understanding of the relationship between taxation methods and economic outcomes.

4.1 KiB Raw Blame History