Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

natural_liberty_of_trade

null

2026-02-23T05:59:38.939598

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates the core principle of voluntary exchange without government interference, specifying the limited role of government in contract enforcement and fraud prevention. It avoids circularity and distinguishes this concept from related but distinct ideas like laissez-faire or free markets more broadly.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual arguments from Book IV, Chapter 8, where he explicitly contrasts the "natural system of perfect liberty and justice" with mercantile restrictions. The definition accurately reflects Smith's specific concerns about government interference in trade and his belief in the superiority of natural market forces.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for this concept, as natural liberty of trade fundamentally concerns the mechanisms and conditions under which voluntary exchanges occur. This is precisely about the structural conditions that enable or constrain market exchange processes.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance as it relates to S4 (intelligence/environmental adaptation) in terms of how economic systems adapt to changing conditions, and S5 (identity/policy) regarding fundamental organizing principles. However, it's somewhat abstract and doesn't map cleanly to operational VSM functions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory power by illuminating the structural mechanism through which Smith believes optimal economic outcomes emerge—the removal of artificial constraints allows natural market forces to operate. It explains both a process (how free exchange works) and Smith's critique of alternative systems.

Evaluation: Natural Liberty Of Trade

definition_precision — 4.0 / 5.0

The definition clearly articulates the core principle of voluntary exchange without government interference, specifying the limited role of government in contract enforcement and fraud prevention. It avoids circularity and distinguishes this concept from related but distinct ideas like laissez-faire or free markets more broadly.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual arguments from Book IV, Chapter 8, where he explicitly contrasts the "natural system of perfect liberty and justice" with mercantile restrictions. The definition accurately reflects Smith's specific concerns about government interference in trade and his belief in the superiority of natural market forces.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for this concept, as natural liberty of trade fundamentally concerns the mechanisms and conditions under which voluntary exchanges occur. This is precisely about the structural conditions that enable or constrain market exchange processes.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance as it relates to S4 (intelligence/environmental adaptation) in terms of how economic systems adapt to changing conditions, and S5 (identity/policy) regarding fundamental organizing principles. However, it's somewhat abstract and doesn't map cleanly to operational VSM functions.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory power by illuminating the structural mechanism through which Smith believes optimal economic outcomes emerge—the removal of artificial constraints allows natural market forces to operate. It explains both a process (how free exchange works) and Smith's critique of alternative systems.

3.9 KiB Raw Blame History