Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_efficiency

null

2026-02-23T00:26:54.217261

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes agricultural efficiency as the effectiveness of resource use in farming, specifying the key inputs (land, labor, capital) and outcomes (productivity, profitability). It avoids circularity and captures a distinct economic concept rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith extensively discusses agricultural improvements, land productivity, and the relationship between efficient farming and economic surplus in Book I, Chapter 11, particularly in his analysis of rent and land use. The entity accurately reflects Smith's treatment of how agricultural improvements generate surplus for rent and economic growth.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain assignment, as agricultural efficiency is fundamentally about optimizing the production process in farming. This clearly belongs in the production category rather than distribution, exchange, or consumption domains.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Agricultural efficiency primarily maps to S1 (primary operations) as it concerns the effectiveness of basic productive activities, but also touches on S3 (internal regulation) regarding resource allocation optimization. While it has VSM relevance, it's not as clearly positioned as more structurally-oriented concepts.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates a key mechanism in Smith's economic theory—how improvements in agricultural productivity create surplus that enables rent payments and supports broader economic development. It explains the structural relationship between farming efficiency and economic growth rather than merely naming a surface phenomenon.

Evaluation: Agricultural Efficiency

definition_precision — 4.0 / 5.0

The definition clearly distinguishes agricultural efficiency as the effectiveness of resource use in farming, specifying the key inputs (land, labor, capital) and outcomes (productivity, profitability). It avoids circularity and captures a distinct economic concept rather than being a vague umbrella term.

source_grounding — 4.0 / 5.0

Smith extensively discusses agricultural improvements, land productivity, and the relationship between efficient farming and economic surplus in Book I, Chapter 11, particularly in his analysis of rent and land use. The entity accurately reflects Smith's treatment of how agricultural improvements generate surplus for rent and economic growth.

domain_placement — 5.0 / 5.0

"Production" is the correct domain assignment, as agricultural efficiency is fundamentally about optimizing the production process in farming. This clearly belongs in the production category rather than distribution, exchange, or consumption domains.

vsm_relevance — 3.0 / 5.0

Agricultural efficiency primarily maps to S1 (primary operations) as it concerns the effectiveness of basic productive activities, but also touches on S3 (internal regulation) regarding resource allocation optimization. While it has VSM relevance, it's not as clearly positioned as more structurally-oriented concepts.

explanatory_value — 4.0 / 5.0

This entity illuminates a key mechanism in Smith's economic theory—how improvements in agricultural productivity create surplus that enables rent payments and supports broader economic development. It explains the structural relationship between farming efficiency and economic growth rather than merely naming a surface phenomenon.

3.8 KiB Raw Blame History