Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

water_carriage

null

2026-02-23T06:38:36.380296

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly distinguishing water-carriage from land transport with specific operational characteristics (ships, boats, water routes). It captures a distinct technological concept with measurable efficiency advantages rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, particularly his detailed comparison of water versus land transport efficiency in Chapter 3. The specific example of ships carrying 200 tons with 6-8 men versus 50 wagons requiring 100 men and 400 horses comes straight from the source material.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain assignment is correct, as water-carriage is fundamentally about the mechanisms that enable and facilitate trade between distant markets. Smith positions it as a key infrastructure enabling the division of labor through expanded market reach.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Water-carriage maps well to S1 (primary operations) as a fundamental operational capability that enables trade, and to S4 (intelligence/environmental adaptation) as it represents how economic systems adapt to geographical constraints. It's a concrete operational mechanism rather than an abstract concept.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism through which transportation technology determines market extent and enables the division of labor. It explains how physical infrastructure creates the conditions for economic specialization and trade expansion.

Evaluation: Water Carriage

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly distinguishing water-carriage from land transport with specific operational characteristics (ships, boats, water routes). It captures a distinct technological concept with measurable efficiency advantages rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, particularly his detailed comparison of water versus land transport efficiency in Chapter 3. The specific example of ships carrying 200 tons with 6-8 men versus 50 wagons requiring 100 men and 400 horses comes straight from the source material.

domain_placement — 5.0 / 5.0

The "Exchange" domain assignment is correct, as water-carriage is fundamentally about the mechanisms that enable and facilitate trade between distant markets. Smith positions it as a key infrastructure enabling the division of labor through expanded market reach.

vsm_relevance — 4.0 / 5.0

Water-carriage maps well to S1 (primary operations) as a fundamental operational capability that enables trade, and to S4 (intelligence/environmental adaptation) as it represents how economic systems adapt to geographical constraints. It's a concrete operational mechanism rather than an abstract concept.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism through which transportation technology determines market extent and enables the division of labor. It explains how physical infrastructure creates the conditions for economic specialization and trade expansion.

3.6 KiB Raw Blame History