feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: market_obstruction
evaluator: null
evaluated_at: '2026-02-23T05:46:17.996294'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes between artificial and natural barriers
that prevent free flow of goods, with specific examples (political boundaries,
poor infrastructure, geographical barriers). It avoids circularity and captures
a distinct economic concept, though it could be slightly more precise about what
constitutes "artificial" versus policy-driven obstructions.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text, specifically his discussion
of how nations controlling river territories can obstruct communication between
inland areas and the sea. The concept accurately reflects Smith's analysis of
how such obstructions limit commerce and market development.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"Regulation" is an appropriate domain since market obstructions often
involve regulatory or policy barriers, though some obstructions (like geographical
barriers) are more structural. The placement captures the primary concern with
artificial barriers while acknowledging natural ones.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental
adaptation) as organizations must understand and adapt to market obstructions
in their environment. It could also relate to S2 (coordination) when obstructions
create coordination problems between system parts.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory power by illuminating a key
mechanism that limits market extent and division of labor. It helps explain why
some regions remain economically underdeveloped and connects infrastructure, geography,
and policy to economic outcomes.
---
# Evaluation: Market Obstruction
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes between artificial and natural barriers that prevent free flow of goods, with specific examples (political boundaries, poor infrastructure, geographical barriers). It avoids circularity and captures a distinct economic concept, though it could be slightly more precise about what constitutes "artificial" versus policy-driven obstructions.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text, specifically his discussion of how nations controlling river territories can obstruct communication between inland areas and the sea. The concept accurately reflects Smith's analysis of how such obstructions limit commerce and market development.
## domain_placement — 4.0 / 5.0
"Regulation" is an appropriate domain since market obstructions often involve regulatory or policy barriers, though some obstructions (like geographical barriers) are more structural. The placement captures the primary concern with artificial barriers while acknowledging natural ones.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as organizations must understand and adapt to market obstructions in their environment. It could also relate to S2 (coordination) when obstructions create coordination problems between system parts.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory power by illuminating a key mechanism that limits market extent and division of labor. It helps explain why some regions remain economically underdeveloped and connects infrastructure, geography, and policy to economic outcomes.