Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

villeinage

null

2026-02-23T06:37:28.070782

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly distinguishing villeinage from other forms of servitude by specifying key characteristics: bound to land, sold with land but not separately, requiring master consent for marriage, and property acquisition limitations. It avoids circularity and provides concrete distinguishing features.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book III, Chapter 2, where he extensively discusses the historical transition from feudal labor arrangements. The definition accurately reflects Smith's analysis of villeinage as a historical labor institution and its gradual disappearance.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain placement is highly appropriate, as villeinage represents a regulatory framework governing labor relations, property rights, and social obligations. This institutional arrangement fundamentally concerns how economic activity was regulated within the feudal system.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Villeinage has moderate VSM relevance, primarily mapping to S3 (internal regulation) as a control mechanism governing labor and land use within feudal systems. However, it's somewhat abstract as a historical institution rather than an active operational component of economic systems.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory value by illuminating the structural mechanisms of pre-capitalist labor relations and how institutional constraints shaped economic behavior. It helps explain the historical transition to more flexible labor arrangements that Smith sees as crucial for economic development.

Evaluation: Villeinage

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly distinguishing villeinage from other forms of servitude by specifying key characteristics: bound to land, sold with land but not separately, requiring master consent for marriage, and property acquisition limitations. It avoids circularity and provides concrete distinguishing features.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book III, Chapter 2, where he extensively discusses the historical transition from feudal labor arrangements. The definition accurately reflects Smith's analysis of villeinage as a historical labor institution and its gradual disappearance.

domain_placement — 5.0 / 5.0

The "Regulation" domain placement is highly appropriate, as villeinage represents a regulatory framework governing labor relations, property rights, and social obligations. This institutional arrangement fundamentally concerns how economic activity was regulated within the feudal system.

vsm_relevance — 3.0 / 5.0

Villeinage has moderate VSM relevance, primarily mapping to S3 (internal regulation) as a control mechanism governing labor and land use within feudal systems. However, it's somewhat abstract as a historical institution rather than an active operational component of economic systems.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory value by illuminating the structural mechanisms of pre-capitalist labor relations and how institutional constraints shaped economic behavior. It helps explain the historical transition to more flexible labor arrangements that Smith sees as crucial for economic development.

3.7 KiB Raw Blame History