Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

exchange

null

2026-02-23T05:24:17.629645

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures exchange as a distinct mechanism that converts surplus production into useful goods while enabling division of labor. It avoids circularity by grounding exchange in the concrete act of trading possessed items for desired ones.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 2, where he explicitly discusses exchange as the mechanism enabling division of labor. The definition accurately reflects Smith's argument that exchange provides assurance for specialized production.

name	value	max_value	rationale
domain_placement	5.0	5.0	The domain assignment "Exchange" is perfectly appropriate as this represents a fundamental economic mechanism in Smith's framework. It belongs squarely in the economic domain as a core process rather than fitting better in any other conceptual category.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Exchange operates across multiple VSM levels - it's a primary operation (S1) when occurring, requires coordination (S2) to prevent conflicts, and involves environmental adaptation (S4) to changing needs. This multi-level nature makes it somewhat difficult to place definitively in the VSM framework.

name	value	max_value	rationale
explanatory_value	5.0	5.0	Exchange provides exceptional explanatory power by illuminating the fundamental mechanism that transforms individual self-interest into social benefit and enables the entire division of labor system. It explains how specialized production becomes viable rather than merely naming a surface phenomenon.

Evaluation: Exchange

definition_precision — 4.0 / 5.0

The definition is precise and captures exchange as a distinct mechanism that converts surplus production into useful goods while enabling division of labor. It avoids circularity by grounding exchange in the concrete act of trading possessed items for desired ones.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 2, where he explicitly discusses exchange as the mechanism enabling division of labor. The definition accurately reflects Smith's argument that exchange provides assurance for specialized production.

domain_placement — 5.0 / 5.0

The domain assignment "Exchange" is perfectly appropriate as this represents a fundamental economic mechanism in Smith's framework. It belongs squarely in the economic domain as a core process rather than fitting better in any other conceptual category.

vsm_relevance — 3.0 / 5.0

Exchange operates across multiple VSM levels - it's a primary operation (S1) when occurring, requires coordination (S2) to prevent conflicts, and involves environmental adaptation (S4) to changing needs. This multi-level nature makes it somewhat difficult to place definitively in the VSM framework.

explanatory_value — 5.0 / 5.0

Exchange provides exceptional explanatory power by illuminating the fundamental mechanism that transforms individual self-interest into social benefit and enables the entire division of labor system. It explains how specialized production becomes viable rather than merely naming a surface phenomenon.

3.4 KiB Raw Blame History