Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_spatial_inequality

null

2026-02-23T00:31:21.178419

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes agricultural spatial inequality as economic disparities between regions based on specific factors (natural advantages, institutions, market access). It avoids circularity and identifies distinct causal mechanisms rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	4.0	5.0	This concept is well-grounded in Book III, Chapter 2, where Smith explicitly discusses how medieval regulations prevented naturally advantaged agricultural regions from exploiting their advantages while hampering disadvantaged areas. The entity accurately reflects Smith's analysis of regional agricultural disparities.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain placement is excellent, as Smith's analysis focuses on how restrictions on trade and market access created and perpetuated these regional inequalities. The concept is fundamentally about exchange relationships and market mechanisms.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it concerns how economic systems respond to environmental advantages and institutional constraints. However, it's somewhat abstract and doesn't clearly align with operational VSM functions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory value by illuminating the structural mechanism through which medieval institutions created persistent regional inequalities, showing how regulatory frameworks can prevent natural comparative advantages from being realized. This goes beyond surface description to reveal underlying economic dynamics.

Evaluation: Agricultural Spatial Inequality

definition_precision — 4.0 / 5.0

The definition clearly distinguishes agricultural spatial inequality as economic disparities between regions based on specific factors (natural advantages, institutions, market access). It avoids circularity and identifies distinct causal mechanisms rather than being a vague umbrella term.

source_grounding — 4.0 / 5.0

This concept is well-grounded in Book III, Chapter 2, where Smith explicitly discusses how medieval regulations prevented naturally advantaged agricultural regions from exploiting their advantages while hampering disadvantaged areas. The entity accurately reflects Smith's analysis of regional agricultural disparities.

domain_placement — 5.0 / 5.0

The "Exchange" domain placement is excellent, as Smith's analysis focuses on how restrictions on trade and market access created and perpetuated these regional inequalities. The concept is fundamentally about exchange relationships and market mechanisms.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it concerns how economic systems respond to environmental advantages and institutional constraints. However, it's somewhat abstract and doesn't clearly align with operational VSM functions.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory value by illuminating the structural mechanism through which medieval institutions created persistent regional inequalities, showing how regulatory frameworks can prevent natural comparative advantages from being realized. This goes beyond surface description to reveal underlying economic dynamics.

3.7 KiB Raw Blame History