Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

retainers_and_dependents_system

null

2026-02-23T06:18:10.672135

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes this system from market-based relationships by focusing on direct subsistence provision and obligation structures. It precisely captures the mechanism of surplus consumption through maintaining dependents rather than through exchange.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book III, Chapter 4, where he explicitly describes how great proprietors maintained retainers and dependents because they lacked commercial outlets for their surplus produce. The concept faithfully represents Smith's historical account of pre-commercial social organization.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placement in "Distribution" is appropriate since this system fundamentally concerns how agricultural surplus is allocated between landowners and their dependents. While it has governance aspects, the core mechanism is distributive rather than purely political.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This maps reasonably well to S1 (primary operations) as a basic social-economic operating system, and has S5 (identity/policy) elements in terms of social structure and power relations. However, it represents a complete alternative to market systems rather than fitting neatly within VSM categories designed for organizational analysis.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power for understanding Smith's historical analysis of how societies transition from feudal to commercial systems. It illuminates the structural mechanism that created feudal power relations and explains why commercial development dissolved these dependencies.

Evaluation: Retainers And Dependents System

definition_precision — 4.0 / 5.0

The definition clearly distinguishes this system from market-based relationships by focusing on direct subsistence provision and obligation structures. It precisely captures the mechanism of surplus consumption through maintaining dependents rather than through exchange.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book III, Chapter 4, where he explicitly describes how great proprietors maintained retainers and dependents because they lacked commercial outlets for their surplus produce. The concept faithfully represents Smith's historical account of pre-commercial social organization.

domain_placement — 4.0 / 5.0

Placement in "Distribution" is appropriate since this system fundamentally concerns how agricultural surplus is allocated between landowners and their dependents. While it has governance aspects, the core mechanism is distributive rather than purely political.

vsm_relevance — 3.0 / 5.0

This maps reasonably well to S1 (primary operations) as a basic social-economic operating system, and has S5 (identity/policy) elements in terms of social structure and power relations. However, it represents a complete alternative to market systems rather than fitting neatly within VSM categories designed for organizational analysis.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power for understanding Smith's historical analysis of how societies transition from feudal to commercial systems. It illuminates the structural mechanism that created feudal power relations and explains why commercial development dissolved these dependencies.

3.7 KiB Raw Blame History