Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_cultivation

null

2026-02-23T00:26:11.435140

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes agricultural cultivation as the comprehensive practice of land preparation, crop growing, and livestock raising, including the full cycle from soil preparation to harvest. It avoids circularity and captures the essential elements of capital and labor investment that make this a distinct economic activity.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book I, Chapter 11 of The Wealth of Nations, where Smith extensively analyzes agricultural cultivation, its effects on land productivity, rents, and the broader economic implications of cultivation practices. The context accurately reflects Smith's examination of how cultivation levels influence economic returns and price dynamics.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is precisely correct, as agricultural cultivation represents one of the fundamental productive activities that Smith analyzes as the foundation of economic wealth. This is a core production process that transforms land and labor into economic value.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Agricultural cultivation maps naturally to S1 (primary operations) as it represents the fundamental productive activity of an agricultural economy. It also has clear connections to S4 (environmental adaptation) given its dependence on environmental conditions and the need to adapt cultivation practices to changing circumstances.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides substantial explanatory power by illuminating the mechanism through which land, labor, and capital combine to create agricultural wealth, and how different levels of cultivation affect the distribution of economic returns between landlords, farmers, and laborers. It captures a fundamental structural relation in Smith's analysis of agricultural economics.

Evaluation: Agricultural Cultivation

definition_precision — 4.0 / 5.0

The definition clearly distinguishes agricultural cultivation as the comprehensive practice of land preparation, crop growing, and livestock raising, including the full cycle from soil preparation to harvest. It avoids circularity and captures the essential elements of capital and labor investment that make this a distinct economic activity.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book I, Chapter 11 of The Wealth of Nations, where Smith extensively analyzes agricultural cultivation, its effects on land productivity, rents, and the broader economic implications of cultivation practices. The context accurately reflects Smith's examination of how cultivation levels influence economic returns and price dynamics.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is precisely correct, as agricultural cultivation represents one of the fundamental productive activities that Smith analyzes as the foundation of economic wealth. This is a core production process that transforms land and labor into economic value.

vsm_relevance — 4.0 / 5.0

Agricultural cultivation maps naturally to S1 (primary operations) as it represents the fundamental productive activity of an agricultural economy. It also has clear connections to S4 (environmental adaptation) given its dependence on environmental conditions and the need to adapt cultivation practices to changing circumstances.

explanatory_value — 4.0 / 5.0

This entity provides substantial explanatory power by illuminating the mechanism through which land, labor, and capital combine to create agricultural wealth, and how different levels of cultivation affect the distribution of economic returns between landlords, farmers, and laborers. It captures a fundamental structural relation in Smith's analysis of agricultural economics.

4.1 KiB Raw Blame History