Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

poll_tax

null

2026-02-23T06:07:26.898343

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes poll taxes as fixed individual levies rather than property or transaction-based taxes, and specifies their role in medieval compensation arrangements. The definition is precise and non-circular, though it could be slightly more concise.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion of medieval town-protector relationships in Book III, Chapter 3. The description accurately reflects Smith's analysis of how poll taxes functioned as part of the economic arrangements between towns and their feudal protectors.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate, as poll taxes represent a specific regulatory mechanism governing the relationship between political authority and economic activity. This fits perfectly within the broader category of institutional arrangements that shape economic behavior.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Poll taxes have some VSM relevance as a coordination mechanism (S2) between towns and protectors, and as part of the regulatory framework (S3) governing medieval economic relationships. However, the mapping is not particularly strong or illuminating for understanding systemic viability.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides good explanatory value by illuminating a specific mechanism through which medieval towns achieved economic autonomy while maintaining political relationships. It reveals how taxation systems can create predictable revenue streams while enabling urban economic development.

Evaluation: Poll Tax

definition_precision — 4.0 / 5.0

The definition clearly distinguishes poll taxes as fixed individual levies rather than property or transaction-based taxes, and specifies their role in medieval compensation arrangements. The definition is precise and non-circular, though it could be slightly more concise.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion of medieval town-protector relationships in Book III, Chapter 3. The description accurately reflects Smith's analysis of how poll taxes functioned as part of the economic arrangements between towns and their feudal protectors.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate, as poll taxes represent a specific regulatory mechanism governing the relationship between political authority and economic activity. This fits perfectly within the broader category of institutional arrangements that shape economic behavior.

vsm_relevance — 3.0 / 5.0

Poll taxes have some VSM relevance as a coordination mechanism (S2) between towns and protectors, and as part of the regulatory framework (S3) governing medieval economic relationships. However, the mapping is not particularly strong or illuminating for understanding systemic viability.

explanatory_value — 4.0 / 5.0

This entity provides good explanatory value by illuminating a specific mechanism through which medieval towns achieved economic autonomy while maintaining political relationships. It reveals how taxation systems can create predictable revenue streams while enabling urban economic development.

3.5 KiB Raw Blame History