Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_isolation_effects

null

2026-02-23T05:11:04.245326

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific economic consequences (limited specialisation, subsistence production, lack of innovation) and establishes a causal mechanism linking isolation to underdevelopment. It avoids circularity by defining the effects rather than simply restating isolation itself.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit discussion of how inland parts of Africa and northern Asia remain "barbarous and uncivilized" due to lack of access to maritime commerce and navigation. The concept emerges naturally from Smith's analysis of geography's role in economic development.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this represents a fundamental theoretical principle about market access and development that spans across Smith's broader economic framework. It's not specific to any particular economic sector or mechanism.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how geographical isolation prevents systems from accessing external intelligence, markets, and innovations necessary for adaptation and growth. The lack of environmental connectivity is a core S4 dysfunction.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism through which geographical factors constrain economic development, connecting Smith's insights about division of labor to real-world development patterns. It explains why certain regions remain underdeveloped despite human potential.

Evaluation: Economic Isolation Effects

definition_precision — 4.0 / 5.0

The definition clearly identifies specific economic consequences (limited specialisation, subsistence production, lack of innovation) and establishes a causal mechanism linking isolation to underdevelopment. It avoids circularity by defining the effects rather than simply restating isolation itself.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit discussion of how inland parts of Africa and northern Asia remain "barbarous and uncivilized" due to lack of access to maritime commerce and navigation. The concept emerges naturally from Smith's analysis of geography's role in economic development.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this represents a fundamental theoretical principle about market access and development that spans across Smith's broader economic framework. It's not specific to any particular economic sector or mechanism.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how geographical isolation prevents systems from accessing external intelligence, markets, and innovations necessary for adaptation and growth. The lack of environmental connectivity is a core S4 dysfunction.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism through which geographical factors constrain economic development, connecting Smith's insights about division of labor to real-world development patterns. It explains why certain regions remain underdeveloped despite human potential.

3.7 KiB Raw Blame History