Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_development_constraints

null

2026-02-23T05:09:40.835114

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific limiting factors (geographical barriers, transportation costs, political obstacles, market size) that constrain economic development and division of labor. It avoids circularity and captures a distinct concept about structural impediments to economic organization.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text from Book I, Chapter 3, where he explicitly discusses how frozen oceans, distant rivers, political control of waterways, and small markets limit trade and specialization. The examples cited directly reflect Smith's analysis of why economic development varies geographically.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this entity addresses fundamental theoretical principles about what limits economic development rather than specific operational mechanisms. It represents core theoretical insights about structural constraints on economic organization.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it concerns how external environmental factors constrain system development. However, it's somewhat abstract and doesn't clearly align with specific VSM operational functions.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides high explanatory value by illuminating the structural mechanisms that prevent regions from achieving optimal economic organization. It explains the "why" behind uneven economic development and connects geographical/political factors to economic outcomes in a theoretically meaningful way.

Evaluation: Economic Development Constraints

definition_precision — 4.0 / 5.0

The definition clearly identifies specific limiting factors (geographical barriers, transportation costs, political obstacles, market size) that constrain economic development and division of labor. It avoids circularity and captures a distinct concept about structural impediments to economic organization.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text from Book I, Chapter 3, where he explicitly discusses how frozen oceans, distant rivers, political control of waterways, and small markets limit trade and specialization. The examples cited directly reflect Smith's analysis of why economic development varies geographically.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this entity addresses fundamental theoretical principles about what limits economic development rather than specific operational mechanisms. It represents core theoretical insights about structural constraints on economic organization.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it concerns how external environmental factors constrain system development. However, it's somewhat abstract and doesn't clearly align with specific VSM operational functions.

explanatory_value — 5.0 / 5.0

This entity provides high explanatory value by illuminating the structural mechanisms that prevent regions from achieving optimal economic organization. It explains the "why" behind uneven economic development and connects geographical/political factors to economic outcomes in a theoretically meaningful way.

3.7 KiB Raw Blame History