Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

free_burgh

null

2026-02-23T05:31:09.142197

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct institutional concept - towns with specific legal privileges that differentiate them from feudal arrangements. It clearly delineates the key characteristics (personal liberty, property rights, trade freedom) without being circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion in Book III, Chapter 3, where he explicitly describes the evolution of towns into "free burghs" with perpetual farm rents and associated privileges. The concept emerges naturally from Smith's historical analysis of urban development.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate, as free burghs represent a fundamental shift in regulatory frameworks from feudal obligations to autonomous urban governance structures. This is precisely about how different regulatory systems enable or constrain economic activity.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Free burghs have some VSM relevance as they represent autonomous governance structures (S3/S5 elements) and operational units (S1), but they are primarily historical institutional forms rather than ongoing systemic functions. The VSM mapping is possible but not particularly natural or illuminating.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the crucial institutional mechanism through which commercial society emerged from feudalism. It explains how specific legal and economic structures enabled the transition from servile to market-based economic relations.

Evaluation: Free Burgh

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct institutional concept - towns with specific legal privileges that differentiate them from feudal arrangements. It clearly delineates the key characteristics (personal liberty, property rights, trade freedom) without being circular.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion in Book III, Chapter 3, where he explicitly describes the evolution of towns into "free burghs" with perpetual farm rents and associated privileges. The concept emerges naturally from Smith's historical analysis of urban development.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate, as free burghs represent a fundamental shift in regulatory frameworks from feudal obligations to autonomous urban governance structures. This is precisely about how different regulatory systems enable or constrain economic activity.

vsm_relevance — 3.0 / 5.0

Free burghs have some VSM relevance as they represent autonomous governance structures (S3/S5 elements) and operational units (S1), but they are primarily historical institutional forms rather than ongoing systemic functions. The VSM mapping is possible but not particularly natural or illuminating.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the crucial institutional mechanism through which commercial society emerged from feudalism. It explains how specific legal and economic structures enabled the transition from servile to market-based economic relations.

3.5 KiB Raw Blame History