Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_spatial_inequality

null

2026-02-23T05:11:38.770157

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes economic spatial inequality as persistent regional differences based on geography and market access, avoiding circularity. It could be slightly more precise about the mechanisms that create persistence, but overall captures a distinct concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis from Book I, Chapter 3, where he explicitly discusses how coastal regions develop differently from river regions and isolated inland areas. The concept accurately reflects Smith's observations about geographical determinants of economic development.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this represents a fundamental theoretical insight about how geography shapes economic outcomes. This is a core theoretical principle rather than a specific mechanism or policy application.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity describes a structural outcome or pattern rather than a functional system component. While spatial inequality might affect various VSM systems, the concept itself doesn't naturally map to any specific VSM function—it's more of an emergent property of economic systems.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying geography and market access as structural determinants of economic disparities. It illuminates why certain regional patterns persist, though it could better specify the underlying mechanisms that maintain these inequalities.

Evaluation: Economic Spatial Inequality

definition_precision — 4.0 / 5.0

The definition clearly distinguishes economic spatial inequality as persistent regional differences based on geography and market access, avoiding circularity. It could be slightly more precise about the mechanisms that create persistence, but overall captures a distinct concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis from Book I, Chapter 3, where he explicitly discusses how coastal regions develop differently from river regions and isolated inland areas. The concept accurately reflects Smith's observations about geographical determinants of economic development.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this represents a fundamental theoretical insight about how geography shapes economic outcomes. This is a core theoretical principle rather than a specific mechanism or policy application.

vsm_relevance — 2.0 / 5.0

This entity describes a structural outcome or pattern rather than a functional system component. While spatial inequality might affect various VSM systems, the concept itself doesn't naturally map to any specific VSM function—it's more of an emergent property of economic systems.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying geography and market access as structural determinants of economic disparities. It illuminates why certain regional patterns persist, though it could better specify the underlying mechanisms that maintain these inequalities.

3.5 KiB Raw Blame History