Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_opportunity_cost

null

2026-02-23T00:28:59.278632

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates opportunity cost as the value of foregone alternatives in agricultural production decisions. It avoids circularity and distinguishes this concept from general agricultural inefficiency by focusing specifically on the trade-offs between different uses of land and labor.

name	value	max_value	rationale
source_grounding	3.0	5.0	While Smith does discuss inefficiencies in medieval agricultural systems and the benefits of market-oriented production, the explicit framing in terms of "opportunity cost" may be applying modern economic terminology to concepts Smith expressed differently. The underlying ideas about foregone alternatives are present but not necessarily in this precise formulation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain is exactly correct for this entity, as it deals directly with how agricultural resources are allocated and utilized in production processes. This is a core production decision-making concept rather than belonging to exchange, distribution, or consumption domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it concerns fundamental production decisions, and also connects to S4 (intelligence) regarding how farmers gather and process information about alternative uses of resources. The concept has clear operational relevance within a viable system framework.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism explaining why medieval agricultural systems were inefficient—farmers lacked the information and freedom to properly evaluate trade-offs between different production choices. This provides genuine insight into the structural causes of agricultural underperformance rather than merely describing symptoms.

Evaluation: Agricultural Opportunity Cost

definition_precision — 4.0 / 5.0

The definition clearly articulates opportunity cost as the value of foregone alternatives in agricultural production decisions. It avoids circularity and distinguishes this concept from general agricultural inefficiency by focusing specifically on the trade-offs between different uses of land and labor.

source_grounding — 3.0 / 5.0

While Smith does discuss inefficiencies in medieval agricultural systems and the benefits of market-oriented production, the explicit framing in terms of "opportunity cost" may be applying modern economic terminology to concepts Smith expressed differently. The underlying ideas about foregone alternatives are present but not necessarily in this precise formulation.

domain_placement — 5.0 / 5.0

The "Production" domain is exactly correct for this entity, as it deals directly with how agricultural resources are allocated and utilized in production processes. This is a core production decision-making concept rather than belonging to exchange, distribution, or consumption domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it concerns fundamental production decisions, and also connects to S4 (intelligence) regarding how farmers gather and process information about alternative uses of resources. The concept has clear operational relevance within a viable system framework.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism explaining why medieval agricultural systems were inefficient—farmers lacked the information and freedom to properly evaluate trade-offs between different production choices. This provides genuine insight into the structural causes of agricultural underperformance rather than merely describing symptoms.

3.9 KiB Raw Blame History