Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_spatial_organisation

null

2026-02-23T05:11:47.944742

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a distinct concept - the spatial distribution of economic activities based on specific factors (market access, transportation costs, division of labour). It avoids circularity and captures something more precise than a vague umbrella term, though it could be slightly more specific about the mechanisms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is strongly grounded in Smith's actual analysis from Book I, Chapter 3, where he explicitly discusses how economic activities cluster along coasts and rivers, how specialisation relates to market proximity, and how isolation leads to economic backwardness. The context directly references these spatial patterns from the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical principle about how economic systems organize spatially. It's not a specific mechanism or policy but rather a broad organizing principle that underlies Smith's economic geography.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as it describes how primary economic operations are distributed) and S4 (as spatial organization reflects adaptation to environmental constraints like geography and transportation). However, it's somewhat abstract and doesn't clearly belong to a single VSM system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating how geographical factors and market forces create systematic patterns of economic development and specialization. It reveals structural relationships between space, transportation, and economic organization rather than merely naming a surface phenomenon.

Evaluation: Economic Spatial Organisation

definition_precision — 4.0 / 5.0

The definition clearly identifies a distinct concept - the spatial distribution of economic activities based on specific factors (market access, transportation costs, division of labour). It avoids circularity and captures something more precise than a vague umbrella term, though it could be slightly more specific about the mechanisms.

source_grounding — 5.0 / 5.0

This entity is strongly grounded in Smith's actual analysis from Book I, Chapter 3, where he explicitly discusses how economic activities cluster along coasts and rivers, how specialisation relates to market proximity, and how isolation leads to economic backwardness. The context directly references these spatial patterns from the source text.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical principle about how economic systems organize spatially. It's not a specific mechanism or policy but rather a broad organizing principle that underlies Smith's economic geography.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as it describes how primary economic operations are distributed) and S4 (as spatial organization reflects adaptation to environmental constraints like geography and transportation). However, it's somewhat abstract and doesn't clearly belong to a single VSM system.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating how geographical factors and market forces create systematic patterns of economic development and specialization. It reveals structural relationships between space, transportation, and economic organization rather than merely naming a surface phenomenon.

3.9 KiB Raw Blame History