Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

urban_autonomy

null

2026-02-23T06:35:59.802522

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes urban autonomy as self-governance through royal charters, separate from feudal control, with specific institutional features (legal systems, commercial regulations). It avoids circularity and captures a distinct historical-economic phenomenon rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book III, Chapter 3, where he extensively discusses how towns gained independence from feudal lords through charters and privileges. Smith explicitly examines this transition as fundamental to commercial development.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate, as urban autonomy fundamentally concerns the establishment of new regulatory frameworks and governance structures. This represents a shift in who controls economic rules and how they are enforced.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Urban autonomy maps well to S3 (internal regulation) as it establishes new governance and audit mechanisms, and to S5 (identity/policy) as it represents towns defining their own identity separate from feudal structures. The institutional framework aspect gives it clear VSM relevance.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial structural mechanism in Smith's account of how market economies emerged from feudal systems. It explains the institutional prerequisites for commercial development and shows how governance structures enable economic transformation.

Evaluation: Urban Autonomy

definition_precision — 4.0 / 5.0

The definition clearly distinguishes urban autonomy as self-governance through royal charters, separate from feudal control, with specific institutional features (legal systems, commercial regulations). It avoids circularity and captures a distinct historical-economic phenomenon rather than a vague concept.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book III, Chapter 3, where he extensively discusses how towns gained independence from feudal lords through charters and privileges. Smith explicitly examines this transition as fundamental to commercial development.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate, as urban autonomy fundamentally concerns the establishment of new regulatory frameworks and governance structures. This represents a shift in who controls economic rules and how they are enforced.

vsm_relevance — 4.0 / 5.0

Urban autonomy maps well to S3 (internal regulation) as it establishes new governance and audit mechanisms, and to S5 (identity/policy) as it represents towns defining their own identity separate from feudal structures. The institutional framework aspect gives it clear VSM relevance.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial structural mechanism in Smith's account of how market economies emerged from feudal systems. It explains the institutional prerequisites for commercial development and shows how governance structures enable economic transformation.

3.4 KiB Raw Blame History