Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

carriage_value_savings

null

2026-02-23T04:41:55.332666

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific economic mechanism - the dual advantage of receiving transportation costs in selling prices while saving them in purchases. The concept is well-bounded and non-circular, though it could be slightly more precise about the exact mechanics of how this value transfer occurs.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how proximity to towns affects both selling and purchasing advantages for rural producers. The entity accurately captures Smith's reasoning about spatial economic advantages without introducing foreign concepts.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate, as this concept fundamentally concerns how market proximity affects the terms and costs of exchange transactions. The spatial dimension of exchange relationships is central to this concept's explanatory power.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how economic actors adapt to their spatial environment to gain advantages. However, it's more of a structural economic relationship than a clear cybernetic function.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating a specific mechanism that drives spatial economic inequality and land value differentials. It explains not just what happens (higher land values near towns) but precisely why it happens through the dual savings/revenue mechanism.

Evaluation: Carriage Value Savings

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific economic mechanism - the dual advantage of receiving transportation costs in selling prices while saving them in purchases. The concept is well-bounded and non-circular, though it could be slightly more precise about the exact mechanics of how this value transfer occurs.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how proximity to towns affects both selling and purchasing advantages for rural producers. The entity accurately captures Smith's reasoning about spatial economic advantages without introducing foreign concepts.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate, as this concept fundamentally concerns how market proximity affects the terms and costs of exchange transactions. The spatial dimension of exchange relationships is central to this concept's explanatory power.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how economic actors adapt to their spatial environment to gain advantages. However, it's more of a structural economic relationship than a clear cybernetic function.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating a specific mechanism that drives spatial economic inequality and land value differentials. It explains not just what happens (higher land values near towns) but precisely why it happens through the dual savings/revenue mechanism.

3.6 KiB Raw Blame History