Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

rural_urban_reciprocity

null

2026-02-23T06:19:52.428139

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific concept of mutual economic dependency between rural and urban areas through specialized production and exchange. It avoids circularity and distinguishes this reciprocal relationship from simple trade by emphasizing the balanced, mutually beneficial nature of the exchange.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text, particularly Book III, Chapter 1, where he explicitly discusses how towns and countryside serve each other's needs through specialization. Smith uses this relationship as a key example to counter mercantilist zero-sum thinking about trade.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for this concept, as it fundamentally concerns the mechanisms and benefits of commercial exchange between different economic sectors. The reciprocal nature of the relationship is central to Smith's theory of exchange and market dynamics.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as a fundamental operational relationship) or S2 (as a coordination mechanism between different economic sectors). However, it's more of a structural relationship than a clear system function, making VSM placement somewhat ambiguous.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating how the division of labor creates mutual benefits rather than winners and losers, which is fundamental to Smith's critique of mercantilism. It explains a key mechanism by which commercial society generates prosperity for all participants through specialization.

Evaluation: Rural Urban Reciprocity

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific concept of mutual economic dependency between rural and urban areas through specialized production and exchange. It avoids circularity and distinguishes this reciprocal relationship from simple trade by emphasizing the balanced, mutually beneficial nature of the exchange.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text, particularly Book III, Chapter 1, where he explicitly discusses how towns and countryside serve each other's needs through specialization. Smith uses this relationship as a key example to counter mercantilist zero-sum thinking about trade.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for this concept, as it fundamentally concerns the mechanisms and benefits of commercial exchange between different economic sectors. The reciprocal nature of the relationship is central to Smith's theory of exchange and market dynamics.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as a fundamental operational relationship) or S2 (as a coordination mechanism between different economic sectors). However, it's more of a structural relationship than a clear system function, making VSM placement somewhat ambiguous.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating how the division of labor creates mutual benefits rather than winners and losers, which is fundamental to Smith's critique of mercantilism. It explains a key mechanism by which commercial society generates prosperity for all participants through specialization.

3.7 KiB Raw Blame History