Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

market_obstruction

null

2026-02-23T05:46:17.996294

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between artificial and natural barriers that prevent free flow of goods, with specific examples (political boundaries, poor infrastructure, geographical barriers). It avoids circularity and captures a distinct economic concept, though it could be slightly more precise about what constitutes "artificial" versus policy-driven obstructions.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, specifically his discussion of how nations controlling river territories can obstruct communication between inland areas and the sea. The concept accurately reflects Smith's analysis of how such obstructions limit commerce and market development.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Regulation" is an appropriate domain since market obstructions often involve regulatory or policy barriers, though some obstructions (like geographical barriers) are more structural. The placement captures the primary concern with artificial barriers while acknowledging natural ones.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as organizations must understand and adapt to market obstructions in their environment. It could also relate to S2 (coordination) when obstructions create coordination problems between system parts.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating a key mechanism that limits market extent and division of labor. It helps explain why some regions remain economically underdeveloped and connects infrastructure, geography, and policy to economic outcomes.

Evaluation: Market Obstruction

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between artificial and natural barriers that prevent free flow of goods, with specific examples (political boundaries, poor infrastructure, geographical barriers). It avoids circularity and captures a distinct economic concept, though it could be slightly more precise about what constitutes "artificial" versus policy-driven obstructions.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, specifically his discussion of how nations controlling river territories can obstruct communication between inland areas and the sea. The concept accurately reflects Smith's analysis of how such obstructions limit commerce and market development.

domain_placement — 4.0 / 5.0

"Regulation" is an appropriate domain since market obstructions often involve regulatory or policy barriers, though some obstructions (like geographical barriers) are more structural. The placement captures the primary concern with artificial barriers while acknowledging natural ones.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as organizations must understand and adapt to market obstructions in their environment. It could also relate to S2 (coordination) when obstructions create coordination problems between system parts.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating a key mechanism that limits market extent and division of labor. It helps explain why some regions remain economically underdeveloped and connects infrastructure, geography, and policy to economic outcomes.

3.7 KiB Raw Blame History