Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_development_sequence

null

2026-02-23T05:10:04.739810

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific sequential pattern of economic development based on transportation infrastructure, moving from water-carriage to inland navigation to land-carriage. It avoids circularity and captures a distinct developmental mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit discussion in Book I, Chapter 3, where he describes how improvements in art and industry follow this exact sequence based on market access through different transportation modes. The concept faithfully represents Smith's actual argument about development patterns.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this describes a broad theoretical principle about how economic development unfolds across different geographical and infrastructural contexts. It represents a foundational theoretical insight rather than a specific mechanism or policy.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily relating to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to environmental constraints like transportation infrastructure. However, it's somewhat abstract and doesn't map cleanly to operational VSM functions.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the underlying mechanism that drives spatial patterns of economic development—namely, how transportation costs and market access determine the sequence of regional growth. It reveals a structural relationship between infrastructure and development timing.

Evaluation: Economic Development Sequence

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific sequential pattern of economic development based on transportation infrastructure, moving from water-carriage to inland navigation to land-carriage. It avoids circularity and captures a distinct developmental mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit discussion in Book I, Chapter 3, where he describes how improvements in art and industry follow this exact sequence based on market access through different transportation modes. The concept faithfully represents Smith's actual argument about development patterns.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this describes a broad theoretical principle about how economic development unfolds across different geographical and infrastructural contexts. It represents a foundational theoretical insight rather than a specific mechanism or policy.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily relating to S4 (intelligence/environmental adaptation) as it describes how economic systems adapt to environmental constraints like transportation infrastructure. However, it's somewhat abstract and doesn't map cleanly to operational VSM functions.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the underlying mechanism that drives spatial patterns of economic development—namely, how transportation costs and market access determine the sequence of regional growth. It reveals a structural relationship between infrastructure and development timing.

3.8 KiB Raw Blame History