feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: inland_navigation_extent
evaluator: null
evaluated_at: '2026-02-23T05:37:22.037252'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes inland navigation extent as a measurable
geographical concept - the total area reachable by waterways. It avoids circularity
and establishes a clear causal link to market size and division of labour.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's specific examples from Book
I, Chapter 3, where he explicitly discusses the Nile, Ganges, and Chinese river
systems as enabling extensive inland navigation and early economic development.
The concept emerges naturally from Smith's comparative analysis.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since inland navigation
extent directly determines the geographical scope of markets and trade relationships.
This is fundamentally about the infrastructure that enables exchange between distant
producers and consumers.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents how economic systems adapt to and leverage geographical environmental
features. It also connects to S1 as it affects the operational reach of primary
economic activities.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity illuminates a crucial structural mechanism in Smith's theory
- how geographical features create the physical infrastructure necessary for market
expansion, which in turn enables greater division of labour. It explains why some
civilizations developed economically earlier than others.
---
# Evaluation: Inland Navigation Extent
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes inland navigation extent as a measurable geographical concept - the total area reachable by waterways. It avoids circularity and establishes a clear causal link to market size and division of labour.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's specific examples from Book I, Chapter 3, where he explicitly discusses the Nile, Ganges, and Chinese river systems as enabling extensive inland navigation and early economic development. The concept emerges naturally from Smith's comparative analysis.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since inland navigation extent directly determines the geographical scope of markets and trade relationships. This is fundamentally about the infrastructure that enables exchange between distant producers and consumers.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents how economic systems adapt to and leverage geographical environmental features. It also connects to S1 as it affects the operational reach of primary economic activities.
## explanatory_value — 5.0 / 5.0
This entity illuminates a crucial structural mechanism in Smith's theory - how geographical features create the physical infrastructure necessary for market expansion, which in turn enables greater division of labour. It explains why some civilizations developed economically earlier than others.