feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: river_navigation_infrastructure
evaluator: null
evaluated_at: '2026-02-23T06:19:27.444739'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes between natural waterways and artificial
improvements (canals, improved channels) and specifies their economic function
in facilitating goods movement and market creation. It avoids circularity and
captures a distinct infrastructural concept with clear boundaries.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's explicit examples from Book
I, Chapter 3, where he discusses Egypt, Bengal, and China's river systems and
canals as foundational to early economic development. The connection between navigation
infrastructure and market extent is a core theme Smith develops extensively.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: Placement in the "Exchange" domain is precisely correct, as river navigation
infrastructure directly enables the physical movement of goods that makes exchange
possible across geographic distances. This infrastructure is fundamental to Smith's
analysis of how markets expand beyond local boundaries.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S1 (primary operations) as the basic infrastructure
enabling economic activity, and to S4 (intelligence/adaptation) as it represents
how societies adapt to geographic constraints to expand markets. The infrastructure
serves as both operational foundation and strategic capability.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: "This entity illuminates a crucial structural mechanism in Smith's theory\u2014\
how physical infrastructure determines market extent, which in turn enables division\
\ of labor and economic development. It explains the causal relationship between\
\ geography, transportation, and economic complexity rather than merely naming\
\ a phenomenon."
---
# Evaluation: River Navigation Infrastructure
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes between natural waterways and artificial improvements (canals, improved channels) and specifies their economic function in facilitating goods movement and market creation. It avoids circularity and captures a distinct infrastructural concept with clear boundaries.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's explicit examples from Book I, Chapter 3, where he discusses Egypt, Bengal, and China's river systems and canals as foundational to early economic development. The connection between navigation infrastructure and market extent is a core theme Smith develops extensively.
## domain_placement — 5.0 / 5.0
Placement in the "Exchange" domain is precisely correct, as river navigation infrastructure directly enables the physical movement of goods that makes exchange possible across geographic distances. This infrastructure is fundamental to Smith's analysis of how markets expand beyond local boundaries.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S1 (primary operations) as the basic infrastructure enabling economic activity, and to S4 (intelligence/adaptation) as it represents how societies adapt to geographic constraints to expand markets. The infrastructure serves as both operational foundation and strategic capability.
## explanatory_value — 5.0 / 5.0
This entity illuminates a crucial structural mechanism in Smith's theory—how physical infrastructure determines market extent, which in turn enables division of labor and economic development. It explains the causal relationship between geography, transportation, and economic complexity rather than merely naming a phenomenon.