Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_development_geography

null

2026-02-23T05:09:57.084640

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes economic development geography as the study of how spatial relationships influence economic patterns, avoiding circularity. It could be slightly more precise about the mechanisms involved, but successfully captures a distinct analytical concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is exceptionally well-grounded in Smith's actual text, as Book I, Chapter 3 explicitly analyzes how geographical features like coastlines, rivers, and canals determine industrial development patterns. The entity directly reflects Smith's core argument in that chapter.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the correct domain placement since this represents Smith's theoretical framework for understanding spatial economic development rather than a specific policy or operational mechanism. It's a foundational analytical concept.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to and leverage their geographical environment for development. It also has some relevance to S1 as it affects primary operations across regions.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural relationship between geography and economic development patterns. It explains fundamental mechanisms behind regional economic differences and specialization patterns that Smith identifies.

Evaluation: Economic Development Geography

definition_precision — 4.0 / 5.0

The definition clearly distinguishes economic development geography as the study of how spatial relationships influence economic patterns, avoiding circularity. It could be slightly more precise about the mechanisms involved, but successfully captures a distinct analytical concept.

source_grounding — 5.0 / 5.0

This entity is exceptionally well-grounded in Smith's actual text, as Book I, Chapter 3 explicitly analyzes how geographical features like coastlines, rivers, and canals determine industrial development patterns. The entity directly reflects Smith's core argument in that chapter.

domain_placement — 5.0 / 5.0

"General Theory" is the correct domain placement since this represents Smith's theoretical framework for understanding spatial economic development rather than a specific policy or operational mechanism. It's a foundational analytical concept.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to and leverage their geographical environment for development. It also has some relevance to S1 as it affects primary operations across regions.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural relationship between geography and economic development patterns. It explains fundamental mechanisms behind regional economic differences and specialization patterns that Smith identifies.

3.4 KiB Raw Blame History