Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

stamp_duties

null

2026-02-23T06:24:28.139584

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly specifying that stamp duties are taxes on legal documents and property transfers requiring stamps of specified values. It distinctly identifies the mechanism (stamps) and scope (property transfers) without being circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text, as he explicitly discusses stamp duties in Book V, Chapter 2 as part of his analysis of taxation methods. The definition accurately reflects Smith's treatment of these taxes on property transfers.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as stamp duties represent a specific application of Smith's broader theoretical framework on taxation principles. While it could potentially fit under a more specific "Taxation" domain, the current placement captures its role in his systematic analysis of revenue generation.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Stamp duties have moderate VSM relevance, primarily mapping to S3 (internal regulation) as a control mechanism for monitoring and taxing property transfers. However, they also touch on S1 (operational revenue generation), making the VSM placement somewhat distributed rather than clearly focused.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory value by illuminating a specific fiscal mechanism that demonstrates Smith's principles about tax certainty, collection efficiency, and economic effects. It reveals how taxation methods can simultaneously generate revenue while influencing capital allocation and investment behavior.

Evaluation: Stamp Duties

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly specifying that stamp duties are taxes on legal documents and property transfers requiring stamps of specified values. It distinctly identifies the mechanism (stamps) and scope (property transfers) without being circular.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text, as he explicitly discusses stamp duties in Book V, Chapter 2 as part of his analysis of taxation methods. The definition accurately reflects Smith's treatment of these taxes on property transfers.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as stamp duties represent a specific application of Smith's broader theoretical framework on taxation principles. While it could potentially fit under a more specific "Taxation" domain, the current placement captures its role in his systematic analysis of revenue generation.

vsm_relevance — 3.0 / 5.0

Stamp duties have moderate VSM relevance, primarily mapping to S3 (internal regulation) as a control mechanism for monitoring and taxing property transfers. However, they also touch on S1 (operational revenue generation), making the VSM placement somewhat distributed rather than clearly focused.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory value by illuminating a specific fiscal mechanism that demonstrates Smith's principles about tax certainty, collection efficiency, and economic effects. It reveals how taxation methods can simultaneously generate revenue while influencing capital allocation and investment behavior.

3.5 KiB Raw Blame History