Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_autonomy_gradient

null

2026-02-23T05:09:05.217933

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a spectrum concept with specific endpoints (feudal servitude to commercial autonomy) and identifies concrete examples of actors at different positions. The concept is distinct and avoids circularity, though "economic freedom" could be slightly more precisely defined.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Book III, Chapter 3, where Smith explicitly discusses the varying degrees of freedom among different economic actors (villeins, burghers, landowners) and traces the historical progression from feudal constraints to commercial liberty. The gradient concept accurately captures Smith's analysis of uneven economic development.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical framework that Smith uses to explain economic development patterns. It's not specific to any particular economic sector but rather describes a structural principle underlying market emergence.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily relating to S4 (intelligence/adaptation) as it describes how economic systems adapt and evolve their institutional arrangements over time. However, it's somewhat abstract and doesn't map cleanly to operational VSM functions.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the mechanism through which market economies emerge from feudal systems through gradual institutional change. It explains why economic development was uneven and how different levels of autonomy created the diversity necessary for market formation.

Evaluation: Economic Autonomy Gradient

definition_precision — 4.0 / 5.0

The definition clearly articulates a spectrum concept with specific endpoints (feudal servitude to commercial autonomy) and identifies concrete examples of actors at different positions. The concept is distinct and avoids circularity, though "economic freedom" could be slightly more precisely defined.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Book III, Chapter 3, where Smith explicitly discusses the varying degrees of freedom among different economic actors (villeins, burghers, landowners) and traces the historical progression from feudal constraints to commercial liberty. The gradient concept accurately captures Smith's analysis of uneven economic development.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical framework that Smith uses to explain economic development patterns. It's not specific to any particular economic sector but rather describes a structural principle underlying market emergence.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily relating to S4 (intelligence/adaptation) as it describes how economic systems adapt and evolve their institutional arrangements over time. However, it's somewhat abstract and doesn't map cleanly to operational VSM functions.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the mechanism through which market economies emerge from feudal systems through gradual institutional change. It explains why economic development was uneven and how different levels of autonomy created the diversity necessary for market formation.

3.8 KiB Raw Blame History