feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: economic_development_geography
evaluator: null
evaluated_at: '2026-02-23T05:09:57.084640'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes economic development geography as
the study of how spatial relationships influence economic patterns, avoiding circularity.
It could be slightly more precise about the mechanisms involved, but successfully
captures a distinct analytical concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is exceptionally well-grounded in Smith's actual text, as
Book I, Chapter 3 explicitly analyzes how geographical features like coastlines,
rivers, and canals determine industrial development patterns. The entity directly
reflects Smith's core argument in that chapter.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the correct domain placement since this represents
Smith''s theoretical framework for understanding spatial economic development
rather than a specific policy or operational mechanism. It''s a foundational analytical
concept.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it concerns how economic systems adapt to and leverage their geographical environment
for development. It also has some relevance to S1 as it affects primary operations
across regions.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating the
structural relationship between geography and economic development patterns. It
explains fundamental mechanisms behind regional economic differences and specialization
patterns that Smith identifies.
---
# Evaluation: Economic Development Geography
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes economic development geography as the study of how spatial relationships influence economic patterns, avoiding circularity. It could be slightly more precise about the mechanisms involved, but successfully captures a distinct analytical concept.
## source_grounding — 5.0 / 5.0
This entity is exceptionally well-grounded in Smith's actual text, as Book I, Chapter 3 explicitly analyzes how geographical features like coastlines, rivers, and canals determine industrial development patterns. The entity directly reflects Smith's core argument in that chapter.
## domain_placement — 5.0 / 5.0
"General Theory" is the correct domain placement since this represents Smith's theoretical framework for understanding spatial economic development rather than a specific policy or operational mechanism. It's a foundational analytical concept.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to and leverage their geographical environment for development. It also has some relevance to S1 as it affects primary operations across regions.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating the structural relationship between geography and economic development patterns. It explains fundamental mechanisms behind regional economic differences and specialization patterns that Smith identifies.