feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: retainers_and_dependents_system
evaluator: null
evaluated_at: '2026-02-23T06:18:10.672135'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes this system from market-based relationships
by focusing on direct subsistence provision and obligation structures. It precisely
captures the mechanism of surplus consumption through maintaining dependents rather
than through exchange.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's analysis in Book III, Chapter
4, where he explicitly describes how great proprietors maintained retainers and
dependents because they lacked commercial outlets for their surplus produce. The
concept faithfully represents Smith's historical account of pre-commercial social
organization.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: Placement in "Distribution" is appropriate since this system fundamentally
concerns how agricultural surplus is allocated between landowners and their dependents.
While it has governance aspects, the core mechanism is distributive rather than
purely political.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This maps reasonably well to S1 (primary operations) as a basic social-economic
operating system, and has S5 (identity/policy) elements in terms of social structure
and power relations. However, it represents a complete alternative to market systems
rather than fitting neatly within VSM categories designed for organizational analysis.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides crucial explanatory power for understanding Smith's
historical analysis of how societies transition from feudal to commercial systems.
It illuminates the structural mechanism that created feudal power relations and
explains why commercial development dissolved these dependencies.
---
# Evaluation: Retainers And Dependents System
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes this system from market-based relationships by focusing on direct subsistence provision and obligation structures. It precisely captures the mechanism of surplus consumption through maintaining dependents rather than through exchange.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's analysis in Book III, Chapter 4, where he explicitly describes how great proprietors maintained retainers and dependents because they lacked commercial outlets for their surplus produce. The concept faithfully represents Smith's historical account of pre-commercial social organization.
## domain_placement — 4.0 / 5.0
Placement in "Distribution" is appropriate since this system fundamentally concerns how agricultural surplus is allocated between landowners and their dependents. While it has governance aspects, the core mechanism is distributive rather than purely political.
## vsm_relevance — 3.0 / 5.0
This maps reasonably well to S1 (primary operations) as a basic social-economic operating system, and has S5 (identity/policy) elements in terms of social structure and power relations. However, it represents a complete alternative to market systems rather than fitting neatly within VSM categories designed for organizational analysis.
## explanatory_value — 5.0 / 5.0
This entity provides crucial explanatory power for understanding Smith's historical analysis of how societies transition from feudal to commercial systems. It illuminates the structural mechanism that created feudal power relations and explains why commercial development dissolved these dependencies.