feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: natural_liberty_in_trade
evaluator: null
evaluated_at: '2026-02-23T05:59:29.774729'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly articulates a distinct principle about economic
freedom leading to efficient resource allocation. While it could be more precise
about what constitutes "artificial restrictions," it avoids circularity and captures
a coherent concept.
- name: source_grounding
value: 3.0
max_value: 5.0
rationale: The entity acknowledges that the concept is "not fully developed in this
chapter" and relies on implications rather than explicit statements from Smith.
While the principle of natural liberty is central to Smith's work, this specific
formulation may extrapolate beyond what Book IV, Chapter 1 directly states.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Exchange" is the perfect domain for this concept, as natural liberty
in trade fundamentally concerns the freedom of individuals to engage in voluntary
economic exchanges. This is precisely what the Exchange domain should encompass.'
- name: vsm_relevance
value: 5.0
max_value: 5.0
rationale: This entity maps excellently to S5 (identity/policy) as it represents
a fundamental organizing principle that guides how an economic system should operate.
It also has clear connections to S4 (intelligence/adaptation) as it describes
how market forces process information to allocate resources.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by identifying the mechanism
through which individual freedom leads to collective prosperity via market forces.
It illuminates a key structural principle rather than merely naming a surface
phenomenon, though the mechanism could be elaborated further.
---
# Evaluation: Natural Liberty In Trade
## definition_precision — 4.0 / 5.0
The definition clearly articulates a distinct principle about economic freedom leading to efficient resource allocation. While it could be more precise about what constitutes "artificial restrictions," it avoids circularity and captures a coherent concept.
## source_grounding — 3.0 / 5.0
The entity acknowledges that the concept is "not fully developed in this chapter" and relies on implications rather than explicit statements from Smith. While the principle of natural liberty is central to Smith's work, this specific formulation may extrapolate beyond what Book IV, Chapter 1 directly states.
## domain_placement — 5.0 / 5.0
"Exchange" is the perfect domain for this concept, as natural liberty in trade fundamentally concerns the freedom of individuals to engage in voluntary economic exchanges. This is precisely what the Exchange domain should encompass.
## vsm_relevance — 5.0 / 5.0
This entity maps excellently to S5 (identity/policy) as it represents a fundamental organizing principle that guides how an economic system should operate. It also has clear connections to S4 (intelligence/adaptation) as it describes how market forces process information to allocate resources.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by identifying the mechanism through which individual freedom leads to collective prosperity via market forces. It illuminates a key structural principle rather than merely naming a surface phenomenon, though the mechanism could be elaborated further.