Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

uncultivated_land_availability

null

2026-02-23T06:34:49.361231

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly distinguishing between economic conditions where land is readily available versus already fully cultivated, and specifically linking this to occupational choice patterns. It avoids circularity and captures a distinct economic phenomenon with measurable characteristics.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis of colonial economic development in Book III, Chapter 1, where he explicitly discusses how land availability affects the transition of artificers from manufacturing to agriculture. The entity accurately reflects Smith's reasoning about why manufacturing develops slowly in new territories.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as this concept fundamentally concerns the allocation of productive resources (land, labor, capital) and the structural conditions that determine what gets produced where. It directly relates to the organization of productive activities in an economy.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it affects the fundamental productive activities of a society, and potentially S4 (environmental adaptation) as it represents an environmental constraint that shapes economic behavior. However, it's more of a structural condition than an active system component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating a key mechanism that shapes economic development patterns - how resource availability fundamentally alters incentive structures and occupational choices. It explains why similar economic actors behave differently in different resource environments, revealing deep structural relationships in economic development.

Evaluation: Uncultivated Land Availability

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly distinguishing between economic conditions where land is readily available versus already fully cultivated, and specifically linking this to occupational choice patterns. It avoids circularity and captures a distinct economic phenomenon with measurable characteristics.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis of colonial economic development in Book III, Chapter 1, where he explicitly discusses how land availability affects the transition of artificers from manufacturing to agriculture. The entity accurately reflects Smith's reasoning about why manufacturing develops slowly in new territories.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as this concept fundamentally concerns the allocation of productive resources (land, labor, capital) and the structural conditions that determine what gets produced where. It directly relates to the organization of productive activities in an economy.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it affects the fundamental productive activities of a society, and potentially S4 (environmental adaptation) as it represents an environmental constraint that shapes economic behavior. However, it's more of a structural condition than an active system component.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating a key mechanism that shapes economic development patterns - how resource availability fundamentally alters incentive structures and occupational choices. It explains why similar economic actors behave differently in different resource environments, revealing deep structural relationships in economic development.

4.1 KiB Raw Blame History