Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

trade_route_dependency

null

2026-02-23T06:33:24.764385

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific economic phenomenon - the reliance on transportation routes that creates both development opportunities and vulnerabilities. It avoids circularity and distinguishes this concept from general trade dependence by focusing specifically on route infrastructure.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit analysis in Book I, Chapter 3, where he systematically explains how industry develops along coastlines, navigable rivers, and canals but fails to develop in their absence. The concept emerges naturally from Smith's own observations about transportation infrastructure and economic development.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this concept deals fundamentally with how goods and services move between markets through transportation networks. Trade route dependency is essentially about the infrastructure that enables exchange relationships.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems must adapt to and depend on their physical environment and infrastructure. It also has relevance to S1 (primary operations) since transportation routes are fundamental to operational viability.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating why economic development is geographically uneven and why certain regions remain underdeveloped despite other advantages. It reveals a structural mechanism that constrains and shapes economic activity patterns.

Evaluation: Trade Route Dependency

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific economic phenomenon - the reliance on transportation routes that creates both development opportunities and vulnerabilities. It avoids circularity and distinguishes this concept from general trade dependence by focusing specifically on route infrastructure.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit analysis in Book I, Chapter 3, where he systematically explains how industry develops along coastlines, navigable rivers, and canals but fails to develop in their absence. The concept emerges naturally from Smith's own observations about transportation infrastructure and economic development.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this concept deals fundamentally with how goods and services move between markets through transportation networks. Trade route dependency is essentially about the infrastructure that enables exchange relationships.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems must adapt to and depend on their physical environment and infrastructure. It also has relevance to S1 (primary operations) since transportation routes are fundamental to operational viability.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating why economic development is geographically uneven and why certain regions remain underdeveloped despite other advantages. It reveals a structural mechanism that constrains and shapes economic activity patterns.

3.7 KiB Raw Blame History