Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_capital_structure

null

2026-02-23T00:25:25.081601

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between different ownership structures of agricultural capital and their effects on incentives. It avoids circularity and captures a specific organizational concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book III, Chapter 2, where he explicitly discusses how different capital ownership arrangements (landlord-provided vs. farmer-owned) create different incentive structures for agricultural improvement.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as this entity deals with the fundamental organization of productive resources in agriculture. It fits naturally within production economics rather than exchange, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it concerns the basic structure of agricultural production units, and also connects to S4 (intelligence/adaptation) through its emphasis on incentives for improvement and innovation.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the causal mechanism between capital ownership structures and productive efficiency. It explains why different organizational forms lead to different outcomes rather than merely describing surface phenomena.

Evaluation: Agricultural Capital Structure

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between different ownership structures of agricultural capital and their effects on incentives. It avoids circularity and captures a specific organizational concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book III, Chapter 2, where he explicitly discusses how different capital ownership arrangements (landlord-provided vs. farmer-owned) create different incentive structures for agricultural improvement.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as this entity deals with the fundamental organization of productive resources in agriculture. It fits naturally within production economics rather than exchange, distribution, or consumption.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it concerns the basic structure of agricultural production units, and also connects to S4 (intelligence/adaptation) through its emphasis on incentives for improvement and innovation.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the causal mechanism between capital ownership structures and productive efficiency. It explains why different organizational forms lead to different outcomes rather than merely describing surface phenomena.

3.2 KiB Raw Blame History