Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_economic_potential

null

2026-02-23T00:26:45.260526

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between actual and potential agricultural productivity, with specific reference to institutional barriers preventing optimization. It avoids circularity and captures a distinct economic concept about unrealized capacity.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book III, Chapter 2, where he explicitly discusses how medieval institutions prevented agricultural regions from achieving their natural productive advantages. The entity accurately reflects Smith's argument about institutional barriers to agricultural optimization.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain placement since this concept deals fundamentally with productive capacity and output potential in agriculture. It fits naturally within production economics rather than exchange, distribution, or consumption categories.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it concerns recognizing and adapting to natural comparative advantages, and to S3 (internal regulation) regarding institutional frameworks that enable or constrain productive potential. It has clear VSM relevance for understanding systemic capacity.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the mechanism through which institutional structures can systematically prevent economic systems from achieving their natural productive capacity. It explains a key structural relationship between institutions, geography, and economic performance in Smith's analysis.

Evaluation: Agricultural Economic Potential

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between actual and potential agricultural productivity, with specific reference to institutional barriers preventing optimization. It avoids circularity and captures a distinct economic concept about unrealized capacity.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book III, Chapter 2, where he explicitly discusses how medieval institutions prevented agricultural regions from achieving their natural productive advantages. The entity accurately reflects Smith's argument about institutional barriers to agricultural optimization.

domain_placement — 5.0 / 5.0

"Production" is the correct domain placement since this concept deals fundamentally with productive capacity and output potential in agriculture. It fits naturally within production economics rather than exchange, distribution, or consumption categories.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it concerns recognizing and adapting to natural comparative advantages, and to S3 (internal regulation) regarding institutional frameworks that enable or constrain productive potential. It has clear VSM relevance for understanding systemic capacity.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the mechanism through which institutional structures can systematically prevent economic systems from achieving their natural productive capacity. It explains a key structural relationship between institutions, geography, and economic performance in Smith's analysis.

3.7 KiB Raw Blame History