Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

land_carriage

null

2026-02-23T05:39:56.715339

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes land-carriage from water-carriage and specifies the key components (waggons, carts, pack animals) and economic characteristics (higher costs, limited market extent). It avoids circularity and captures a distinct transportation mode with specific economic implications.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 3, where he explicitly discusses land-carriage and provides the specific calculations mentioned (hundred men for three weeks, four hundred horses for two hundred tons). The economic analysis of its limitations on market extent is central to Smith's argument.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain placement is correct, as land-carriage is fundamentally about the mechanisms and costs of moving goods between markets. Smith uses it specifically to explain how transportation costs affect the extent of markets and the feasibility of trade.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Land-carriage maps most naturally to S1 (primary operations) as a basic operational capability for moving goods, but it also has S4 implications regarding environmental adaptation to geographic constraints. However, it's primarily an operational tool rather than a systemic function.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism through which transportation costs limit market extent and division of labour. It's not merely descriptive but reveals a fundamental economic constraint that shapes market development and specialization possibilities.

Evaluation: Land Carriage

definition_precision — 4.0 / 5.0

The definition clearly distinguishes land-carriage from water-carriage and specifies the key components (waggons, carts, pack animals) and economic characteristics (higher costs, limited market extent). It avoids circularity and captures a distinct transportation mode with specific economic implications.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 3, where he explicitly discusses land-carriage and provides the specific calculations mentioned (hundred men for three weeks, four hundred horses for two hundred tons). The economic analysis of its limitations on market extent is central to Smith's argument.

domain_placement — 5.0 / 5.0

The "Exchange" domain placement is correct, as land-carriage is fundamentally about the mechanisms and costs of moving goods between markets. Smith uses it specifically to explain how transportation costs affect the extent of markets and the feasibility of trade.

vsm_relevance — 3.0 / 5.0

Land-carriage maps most naturally to S1 (primary operations) as a basic operational capability for moving goods, but it also has S4 implications regarding environmental adaptation to geographic constraints. However, it's primarily an operational tool rather than a systemic function.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism through which transportation costs limit market extent and division of labour. It's not merely descriptive but reveals a fundamental economic constraint that shapes market development and specialization possibilities.

3.6 KiB Raw Blame History