feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: colonial_economic_system_objectives
evaluator: null
evaluated_at: '2026-02-23T04:49:29.268516'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition identifies distinct categories of objectives (economic
development, revenue generation, political control, mutual benefit) but remains
somewhat broad and umbrella-like. While it avoids circularity, it could be more
precise about what constitutes "more open systems" versus "restrictive monopoly
arrangements."
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity accurately reflects Smith's analysis in Book IV, Chapter
7, where he explicitly examines different colonial policy approaches and argues
that monopolistic systems fail to achieve their stated objectives. The contrast
between restrictive and open arrangements is well-grounded in Smith's text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain placement is highly appropriate, as this entity
deals with policy objectives and regulatory approaches to colonial management.
It fits naturally within the broader regulatory framework that Smith analyzes.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S5 (identity/policy) as it deals with high-level
objectives and policy direction for colonial systems. It also has relevance to
S4 (intelligence/adaptation) in terms of how different approaches respond to environmental
conditions and achieve strategic goals.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating the structural
relationship between policy approaches and their effectiveness in achieving stated
objectives. It helps explain why Smith advocates for more open colonial arrangements
over monopolistic ones.
---
# Evaluation: Colonial Economic System Objectives
## definition_precision — 3.0 / 5.0
The definition identifies distinct categories of objectives (economic development, revenue generation, political control, mutual benefit) but remains somewhat broad and umbrella-like. While it avoids circularity, it could be more precise about what constitutes "more open systems" versus "restrictive monopoly arrangements."
## source_grounding — 4.0 / 5.0
This entity accurately reflects Smith's analysis in Book IV, Chapter 7, where he explicitly examines different colonial policy approaches and argues that monopolistic systems fail to achieve their stated objectives. The contrast between restrictive and open arrangements is well-grounded in Smith's text.
## domain_placement — 5.0 / 5.0
The "Regulation" domain placement is highly appropriate, as this entity deals with policy objectives and regulatory approaches to colonial management. It fits naturally within the broader regulatory framework that Smith analyzes.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S5 (identity/policy) as it deals with high-level objectives and policy direction for colonial systems. It also has relevance to S4 (intelligence/adaptation) in terms of how different approaches respond to environmental conditions and achieve strategic goals.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating the structural relationship between policy approaches and their effectiveness in achieving stated objectives. It helps explain why Smith advocates for more open colonial arrangements over monopolistic ones.