Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

window_tax

null

2026-02-23T06:39:29.139581

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying the window tax as a house tax based on window count with noted assessment advantages but distributional problems. It avoids circularity and captures a distinct fiscal mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual discussion of taxation methods in Book V, Chapter 2, where he explicitly analyzes the window tax as an example of house taxation. The characterization of its convenience versus inequality reflects Smith's own assessment.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in "General Theory" domain is appropriate as this represents Smith's theoretical analysis of taxation principles and methods. The window tax serves as a concrete example within his broader theoretical framework on public finance.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	The window tax has some VSM relevance as a regulatory mechanism (S3) for resource extraction and potentially S2 for coordination of public finance, but it's primarily a specific policy instrument rather than a core systemic function. It's more VSM-applicable than purely abstract concepts but not naturally systemic.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory value by illustrating Smith's analysis of how tax design affects both administrative efficiency and distributional equity. It demonstrates the trade-offs between practical implementation and fairness in fiscal policy, revealing important structural tensions in taxation.

Evaluation: Window Tax

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying the window tax as a house tax based on window count with noted assessment advantages but distributional problems. It avoids circularity and captures a distinct fiscal mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual discussion of taxation methods in Book V, Chapter 2, where he explicitly analyzes the window tax as an example of house taxation. The characterization of its convenience versus inequality reflects Smith's own assessment.

domain_placement — 5.0 / 5.0

The placement in "General Theory" domain is appropriate as this represents Smith's theoretical analysis of taxation principles and methods. The window tax serves as a concrete example within his broader theoretical framework on public finance.

vsm_relevance — 3.0 / 5.0

The window tax has some VSM relevance as a regulatory mechanism (S3) for resource extraction and potentially S2 for coordination of public finance, but it's primarily a specific policy instrument rather than a core systemic function. It's more VSM-applicable than purely abstract concepts but not naturally systemic.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory value by illustrating Smith's analysis of how tax design affects both administrative efficiency and distributional equity. It demonstrates the trade-offs between practical implementation and fairness in fiscal policy, revealing important structural tensions in taxation.

3.4 KiB Raw Blame History