Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_accessibility_gradient

null

2026-02-23T05:08:55.979382

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific spatial-economic concept about how market access decreases with distance from trade centers, creating measurable gradients of opportunity. The concept is well-bounded and avoids circularity, though it could be slightly more precise about what constitutes "major trade centres."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit analysis in Book I, Chapter 3, where he describes how industry develops sequentially from coasts and rivers to inland areas and finally remote regions. The concept captures a clear pattern that Smith identifies and explains in the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this concept fundamentally concerns how geographic proximity to markets affects trade opportunities and economic transactions. The accessibility gradient directly shapes patterns of exchange and market participation.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to their geographic environment and information flows. However, it's somewhat abstract and doesn't clearly align with operational VSM functions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory power by illuminating the structural mechanism behind uneven economic development patterns that Smith observes. It explains why certain regions develop specialized industries while others remain primarily agricultural, revealing the spatial logic of market-driven development.

Evaluation: Economic Accessibility Gradient

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific spatial-economic concept about how market access decreases with distance from trade centers, creating measurable gradients of opportunity. The concept is well-bounded and avoids circularity, though it could be slightly more precise about what constitutes "major trade centres."

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit analysis in Book I, Chapter 3, where he describes how industry develops sequentially from coasts and rivers to inland areas and finally remote regions. The concept captures a clear pattern that Smith identifies and explains in the source text.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this concept fundamentally concerns how geographic proximity to markets affects trade opportunities and economic transactions. The accessibility gradient directly shapes patterns of exchange and market participation.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to their geographic environment and information flows. However, it's somewhat abstract and doesn't clearly align with operational VSM functions.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory power by illuminating the structural mechanism behind uneven economic development patterns that Smith observes. It explains why certain regions develop specialized industries while others remain primarily agricultural, revealing the spatial logic of market-driven development.

3.7 KiB Raw Blame History