Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_backwardness

null

2026-02-23T05:09:24.288692

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies economic backwardness as a condition caused by specific structural constraints (limited market access, poor infrastructure, political barriers) and characterized by observable outcomes (limited specialization, subsistence production). While the term "lower levels of economic development" could be more precise, the structural focus makes this a distinct concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, specifically his discussion of inland Africa and northern Asia remaining in "barbarous and uncivilized state" due to lack of maritime commerce access and poor river navigation. The entity accurately captures Smith's causal explanation linking geographic/infrastructure constraints to economic underdevelopment.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical principle in Smith's work about how structural constraints affect economic development. It's not specific to division of labor, markets, or other specialized domains but rather explains broader patterns of economic organization.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how societies fail to adapt to or overcome environmental and infrastructural constraints that limit their economic development. It also relates to S1 (primary operations) in describing the resulting subsistence-level production patterns.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides genuine explanatory power by illuminating the structural mechanisms (transportation, market access, political barriers) that create and perpetuate economic underdevelopment. It goes beyond merely naming a phenomenon to explain the causal relationships Smith identifies between infrastructure and economic organization.

Evaluation: Economic Backwardness

definition_precision — 4.0 / 5.0

The definition clearly identifies economic backwardness as a condition caused by specific structural constraints (limited market access, poor infrastructure, political barriers) and characterized by observable outcomes (limited specialization, subsistence production). While the term "lower levels of economic development" could be more precise, the structural focus makes this a distinct concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, specifically his discussion of inland Africa and northern Asia remaining in "barbarous and uncivilized state" due to lack of maritime commerce access and poor river navigation. The entity accurately captures Smith's causal explanation linking geographic/infrastructure constraints to economic underdevelopment.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical principle in Smith's work about how structural constraints affect economic development. It's not specific to division of labor, markets, or other specialized domains but rather explains broader patterns of economic organization.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how societies fail to adapt to or overcome environmental and infrastructural constraints that limit their economic development. It also relates to S1 (primary operations) in describing the resulting subsistence-level production patterns.

explanatory_value — 5.0 / 5.0

This entity provides genuine explanatory power by illuminating the structural mechanisms (transportation, market access, political barriers) that create and perpetuate economic underdevelopment. It goes beyond merely naming a phenomenon to explain the causal relationships Smith identifies between infrastructure and economic organization.

4.3 KiB Raw Blame History