feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: economic_development_sequence
evaluator: null
evaluated_at: '2026-02-23T05:10:04.739810'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly articulates a specific sequential pattern of economic
development based on transportation infrastructure, moving from water-carriage
to inland navigation to land-carriage. It avoids circularity and captures a distinct
developmental mechanism rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's explicit discussion in Book
I, Chapter 3, where he describes how improvements in art and industry follow this
exact sequence based on market access through different transportation modes.
The concept faithfully represents Smith's actual argument about development patterns.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this describes
a broad theoretical principle about how economic development unfolds across different
geographical and infrastructural contexts. It represents a foundational theoretical
insight rather than a specific mechanism or policy.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily relating to S4 (intelligence/environmental
adaptation) as it describes how economic systems adapt to environmental constraints
like transportation infrastructure. However, it's somewhat abstract and doesn't
map cleanly to operational VSM functions.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: "This entity provides significant explanatory power by illuminating the\
\ underlying mechanism that drives spatial patterns of economic development\u2014\
namely, how transportation costs and market access determine the sequence of regional\
\ growth. It reveals a structural relationship between infrastructure and development\
\ timing."
---
# Evaluation: Economic Development Sequence
## definition_precision — 4.0 / 5.0
The definition clearly articulates a specific sequential pattern of economic development based on transportation infrastructure, moving from water-carriage to inland navigation to land-carriage. It avoids circularity and captures a distinct developmental mechanism rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's explicit discussion in Book I, Chapter 3, where he describes how improvements in art and industry follow this exact sequence based on market access through different transportation modes. The concept faithfully represents Smith's actual argument about development patterns.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this describes a broad theoretical principle about how economic development unfolds across different geographical and infrastructural contexts. It represents a foundational theoretical insight rather than a specific mechanism or policy.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily relating to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to environmental constraints like transportation infrastructure. However, it's somewhat abstract and doesn't map cleanly to operational VSM functions.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating the underlying mechanism that drives spatial patterns of economic development—namely, how transportation costs and market access determine the sequence of regional growth. It reveals a structural relationship between infrastructure and development timing.