feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: colony_economic_system_objectives
evaluator: null
evaluated_at: '2026-02-23T04:54:56.215505'
overall_score: 4.2
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition identifies a distinct concept about colonial policy goals
but remains somewhat vague with phrases like "misaligned with actual interests"
and "mercantilist misconceptions." It could be more precise about what specific
objectives Smith critiques and how they differ from what he considers proper objectives.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity appears well-grounded in Smith's actual critique of colonial
policy in Book V, Chapter 3, where he extensively discusses how mercantilist principles
guide colonial economic systems in ways that harm both parties. The reference
to mercantilist misconceptions aligns with Smith's documented arguments.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is highly appropriate since this entity
concerns policy objectives that guide regulatory frameworks for colonial economic
systems. This fits perfectly within the regulatory/governance conceptual category.
- name: vsm_relevance
value: 5.0
max_value: 5.0
rationale: This entity maps clearly to VSM System 5 (identity/policy), as it deals
with the fundamental objectives and purposes that define what a colonial economic
system is trying to achieve. These objectives represent the highest-level policy
decisions that shape all other system operations.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides good explanatory value by highlighting the structural
problem that colonial systems are designed around flawed objectives, which helps
explain why these systems produce suboptimal outcomes. It illuminates a key mechanism
of systemic dysfunction rather than just describing surface phenomena.
---
# Evaluation: Colony Economic System Objectives
## definition_precision — 3.0 / 5.0
The definition identifies a distinct concept about colonial policy goals but remains somewhat vague with phrases like "misaligned with actual interests" and "mercantilist misconceptions." It could be more precise about what specific objectives Smith critiques and how they differ from what he considers proper objectives.
## source_grounding — 4.0 / 5.0
This entity appears well-grounded in Smith's actual critique of colonial policy in Book V, Chapter 3, where he extensively discusses how mercantilist principles guide colonial economic systems in ways that harm both parties. The reference to mercantilist misconceptions aligns with Smith's documented arguments.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is highly appropriate since this entity concerns policy objectives that guide regulatory frameworks for colonial economic systems. This fits perfectly within the regulatory/governance conceptual category.
## vsm_relevance — 5.0 / 5.0
This entity maps clearly to VSM System 5 (identity/policy), as it deals with the fundamental objectives and purposes that define what a colonial economic system is trying to achieve. These objectives represent the highest-level policy decisions that shape all other system operations.
## explanatory_value — 4.0 / 5.0
The entity provides good explanatory value by highlighting the structural problem that colonial systems are designed around flawed objectives, which helps explain why these systems produce suboptimal outcomes. It illuminates a key mechanism of systemic dysfunction rather than just describing surface phenomena.