Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

demesne

null

2026-02-23T05:05:45.387851

3.8

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes demesne land (retained by lords) from tenant land, providing a precise economic and legal distinction. The definition avoids circularity and captures a specific institutional arrangement within feudal systems.

name	value	max_value	rationale
source_grounding	4.0	5.0	The entity is directly grounded in Smith's discussion of traders on lords' demesnes receiving tax exemptions in Book III, Chapter 3. While the definition expands somewhat beyond Smith's specific mention, it accurately reflects the historical concept Smith was referencing.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since demesnes represent a fundamental institutional structure that underpins Smith's analysis of feudal economic organization. This concept relates to broader theoretical questions about property rights and economic organization.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Demesnes are primarily a static institutional/property arrangement rather than a dynamic system function. While they might loosely relate to S1 (as operational units of production), they don't naturally map to VSM's cybernetic framework focused on organizational control and adaptation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The concept illuminates an important structural mechanism in feudal economics—how land tenure arrangements created distinct economic zones with different privileges and obligations. This helps explain the institutional foundations underlying Smith's discussion of medieval trade and taxation.

Evaluation: Demesne

definition_precision — 4.0 / 5.0

The definition clearly distinguishes demesne land (retained by lords) from tenant land, providing a precise economic and legal distinction. The definition avoids circularity and captures a specific institutional arrangement within feudal systems.

source_grounding — 4.0 / 5.0

The entity is directly grounded in Smith's discussion of traders on lords' demesnes receiving tax exemptions in Book III, Chapter 3. While the definition expands somewhat beyond Smith's specific mention, it accurately reflects the historical concept Smith was referencing.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since demesnes represent a fundamental institutional structure that underpins Smith's analysis of feudal economic organization. This concept relates to broader theoretical questions about property rights and economic organization.

vsm_relevance — 2.0 / 5.0

Demesnes are primarily a static institutional/property arrangement rather than a dynamic system function. While they might loosely relate to S1 (as operational units of production), they don't naturally map to VSM's cybernetic framework focused on organizational control and adaptation.

explanatory_value — 4.0 / 5.0

The concept illuminates an important structural mechanism in feudal economics—how land tenure arrangements created distinct economic zones with different privileges and obligations. This helps explain the institutional foundations underlying Smith's discussion of medieval trade and taxation.

3.4 KiB Raw Blame History