Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mutual_gain_reciprocity

null

2026-02-23T05:56:16.502773

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific economic principle about bilateral benefits in exchange relationships, grounded in specialization and division of labor. It avoids circularity and distinguishes itself from general concepts of trade or cooperation.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's explicit discussion in Book III, Chapter 1 about how town and country mutually benefit from exchange. Smith specifically argues against zero-sum thinking and emphasizes the reciprocal advantages created through specialization.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for this concept, as it fundamentally concerns the mechanisms and outcomes of commercial transactions between different economic actors. This is precisely what exchange theory addresses.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as a fundamental operational principle of exchange) or S2 (as a coordination mechanism that prevents destructive competition). However, it's more of a structural principle than a clear system component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the fundamental mechanism that makes trade beneficial rather than exploitative. It explains how division of labor creates structural conditions for mutual benefit, countering mercantilist zero-sum assumptions.

Evaluation: Mutual Gain Reciprocity

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific economic principle about bilateral benefits in exchange relationships, grounded in specialization and division of labor. It avoids circularity and distinguishes itself from general concepts of trade or cooperation.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's explicit discussion in Book III, Chapter 1 about how town and country mutually benefit from exchange. Smith specifically argues against zero-sum thinking and emphasizes the reciprocal advantages created through specialization.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for this concept, as it fundamentally concerns the mechanisms and outcomes of commercial transactions between different economic actors. This is precisely what exchange theory addresses.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as a fundamental operational principle of exchange) or S2 (as a coordination mechanism that prevents destructive competition). However, it's more of a structural principle than a clear system component.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the fundamental mechanism that makes trade beneficial rather than exploitative. It explains how division of labor creates structural conditions for mutual benefit, countering mercantilist zero-sum assumptions.

3.3 KiB Raw Blame History