feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: mercantile_system_principles
evaluator: null
evaluated_at: '2026-02-23T05:50:49.090129'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies three specific doctrines (precious
metals as wealth, zero-sum trade, colonial subordination) that form a coherent
ideological framework. While "restrictive trade practices" could be more specific,
the core principles are well-delineated and non-circular.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity directly reflects Smith's extensive critique of mercantile
doctrine throughout Book IV, where he systematically examines these exact principles
and their policy implications. The definition accurately captures concepts that
Smith explicitly discusses and refutes.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain since these principles constitute
the theoretical foundation underlying specific mercantile policies rather than
particular economic mechanisms or historical events. This represents the ideological
superstructure that Smith seeks to dismantle.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S5 (identity/policy) as it represents the fundamental
worldview and policy principles that guide mercantile decision-making. It also
connects to S4 (intelligence) in terms of how mercantile thinkers interpret economic
information through their doctrinal lens.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides crucial explanatory power by identifying the underlying
belief system that generates specific mercantile policies, helping explain why
such economically harmful practices persist. It illuminates the ideological mechanism
connecting theory to practice in Smith's critique.
---
# Evaluation: Mercantile System Principles
## definition_precision — 4.0 / 5.0
The definition clearly identifies three specific doctrines (precious metals as wealth, zero-sum trade, colonial subordination) that form a coherent ideological framework. While "restrictive trade practices" could be more specific, the core principles are well-delineated and non-circular.
## source_grounding — 5.0 / 5.0
This entity directly reflects Smith's extensive critique of mercantile doctrine throughout Book IV, where he systematically examines these exact principles and their policy implications. The definition accurately captures concepts that Smith explicitly discusses and refutes.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain since these principles constitute the theoretical foundation underlying specific mercantile policies rather than particular economic mechanisms or historical events. This represents the ideological superstructure that Smith seeks to dismantle.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S5 (identity/policy) as it represents the fundamental worldview and policy principles that guide mercantile decision-making. It also connects to S4 (intelligence) in terms of how mercantile thinkers interpret economic information through their doctrinal lens.
## explanatory_value — 5.0 / 5.0
This entity provides crucial explanatory power by identifying the underlying belief system that generates specific mercantile policies, helping explain why such economically harmful practices persist. It illuminates the ideological mechanism connecting theory to practice in Smith's critique.