Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

metayer

null

2026-02-23T05:52:08.008268

4.6

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise, clearly distinguishing metayage from other agricultural arrangements by specifying the capital ownership (landlord's), labor provision (tenant's), and profit-sharing mechanism (equal division after stock maintenance). This captures a distinct economic relationship rather than a vague category.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book III, Chapter 2, where he explicitly discusses the French metayer system and compares it to slavery and freehold farming. The definition accurately reflects Smith's own characterization of this agricultural arrangement.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as metayage is fundamentally about organizing agricultural production through a specific capital-labor arrangement. This fits perfectly within Smith's analysis of different modes of productive organization.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it describes a specific operational structure for agricultural production, and has some S3 relevance regarding how the profit-sharing arrangement regulates tenant behavior. The incentive structure makes it more than VSM-neutral.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism in Smith's analysis of agricultural development—how different tenure arrangements create different incentives for investment and improvement. It demonstrates a structural relationship between property rights, capital provision, and productive efficiency.

Evaluation: Metayer

definition_precision — 5.0 / 5.0

The definition is highly precise, clearly distinguishing metayage from other agricultural arrangements by specifying the capital ownership (landlord's), labor provision (tenant's), and profit-sharing mechanism (equal division after stock maintenance). This captures a distinct economic relationship rather than a vague category.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book III, Chapter 2, where he explicitly discusses the French metayer system and compares it to slavery and freehold farming. The definition accurately reflects Smith's own characterization of this agricultural arrangement.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as metayage is fundamentally about organizing agricultural production through a specific capital-labor arrangement. This fits perfectly within Smith's analysis of different modes of productive organization.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it describes a specific operational structure for agricultural production, and has some S3 relevance regarding how the profit-sharing arrangement regulates tenant behavior. The incentive structure makes it more than VSM-neutral.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism in Smith's analysis of agricultural development—how different tenure arrangements create different incentives for investment and improvement. It demonstrates a structural relationship between property rights, capital provision, and productive efficiency.

3.5 KiB Raw Blame History