Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

urban_rural_reciprocity

null

2026-02-23T06:36:09.322206

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific economic relationship with distinct components (urban markets/manufacturing vs. rural food/raw materials) and identifies the key mechanism of mutual dependence. It avoids circularity and captures a concrete structural relationship rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis in Book III, Chapter 3, where he explicitly discusses the interdependent relationship between towns and countryside and how their mutual development drives economic progress. The concept reflects Smith's actual argument rather than imposing external frameworks.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this entity describes a fundamental pattern of economic exchange and trade relationships between different economic sectors. The reciprocal trading relationship is the core mechanism that defines this concept.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has some VSM relevance as it describes coordination mechanisms between different economic subsystems (S2) and could relate to how economic systems maintain internal regulation (S3). However, it's more of a structural relationship pattern than a clear VSM operational component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating how economic development occurs through structural interdependence rather than isolated growth, revealing the mechanism by which urban and rural sectors mutually stimulate each other's development. It explains a key driver of Smith's theory of economic progress.

Evaluation: Urban Rural Reciprocity

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific economic relationship with distinct components (urban markets/manufacturing vs. rural food/raw materials) and identifies the key mechanism of mutual dependence. It avoids circularity and captures a concrete structural relationship rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis in Book III, Chapter 3, where he explicitly discusses the interdependent relationship between towns and countryside and how their mutual development drives economic progress. The concept reflects Smith's actual argument rather than imposing external frameworks.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this entity describes a fundamental pattern of economic exchange and trade relationships between different economic sectors. The reciprocal trading relationship is the core mechanism that defines this concept.

vsm_relevance — 3.0 / 5.0

This entity has some VSM relevance as it describes coordination mechanisms between different economic subsystems (S2) and could relate to how economic systems maintain internal regulation (S3). However, it's more of a structural relationship pattern than a clear VSM operational component.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating how economic development occurs through structural interdependence rather than isolated growth, revealing the mechanism by which urban and rural sectors mutually stimulate each other's development. It explains a key driver of Smith's theory of economic progress.

3.7 KiB Raw Blame History