Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

natural_liberty_in_trade

null

2026-02-23T05:59:29.774729

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a distinct principle about economic freedom leading to efficient resource allocation. While it could be more precise about what constitutes "artificial restrictions," it avoids circularity and captures a coherent concept.

name	value	max_value	rationale
source_grounding	3.0	5.0	The entity acknowledges that the concept is "not fully developed in this chapter" and relies on implications rather than explicit statements from Smith. While the principle of natural liberty is central to Smith's work, this specific formulation may extrapolate beyond what Book IV, Chapter 1 directly states.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the perfect domain for this concept, as natural liberty in trade fundamentally concerns the freedom of individuals to engage in voluntary economic exchanges. This is precisely what the Exchange domain should encompass.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps excellently to S5 (identity/policy) as it represents a fundamental organizing principle that guides how an economic system should operate. It also has clear connections to S4 (intelligence/adaptation) as it describes how market forces process information to allocate resources.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying the mechanism through which individual freedom leads to collective prosperity via market forces. It illuminates a key structural principle rather than merely naming a surface phenomenon, though the mechanism could be elaborated further.

Evaluation: Natural Liberty In Trade

definition_precision — 4.0 / 5.0

The definition clearly articulates a distinct principle about economic freedom leading to efficient resource allocation. While it could be more precise about what constitutes "artificial restrictions," it avoids circularity and captures a coherent concept.

source_grounding — 3.0 / 5.0

The entity acknowledges that the concept is "not fully developed in this chapter" and relies on implications rather than explicit statements from Smith. While the principle of natural liberty is central to Smith's work, this specific formulation may extrapolate beyond what Book IV, Chapter 1 directly states.

domain_placement — 5.0 / 5.0

"Exchange" is the perfect domain for this concept, as natural liberty in trade fundamentally concerns the freedom of individuals to engage in voluntary economic exchanges. This is precisely what the Exchange domain should encompass.

vsm_relevance — 5.0 / 5.0

This entity maps excellently to S5 (identity/policy) as it represents a fundamental organizing principle that guides how an economic system should operate. It also has clear connections to S4 (intelligence/adaptation) as it describes how market forces process information to allocate resources.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying the mechanism through which individual freedom leads to collective prosperity via market forces. It illuminates a key structural principle rather than merely naming a surface phenomenon, though the mechanism could be elaborated further.

3.5 KiB Raw Blame History