feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,61 @@
---
entity_slug: colony_economic_system_principles
evaluator: null
evaluated_at: '2026-02-23T04:55:21.608735'
overall_score: 3.2
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is vague and circular, essentially saying "principles
that underlie colonial economic arrangements should be based on principles of
natural liberty." It doesn't clearly distinguish what makes these principles specifically
about colonies versus general economic principles.
- name: source_grounding
value: 3.0
max_value: 5.0
rationale: While Smith does discuss colonial policy and advocates for free trade
over mercantilism in Book V, the entity appears to abstract his specific arguments
into a generalized concept of "colony economic system principles" that may not
reflect how Smith actually structured his analysis.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Regulation" domain placement is appropriate since Smith's colonial
discussions in Book V focus heavily on regulatory frameworks, trade restrictions,
and government policies affecting colonial commerce.
- name: vsm_relevance
value: 5.0
max_value: 5.0
rationale: This entity maps clearly to S5 (identity/policy) as it deals with fundamental
principles and policy frameworks that define how colonial economic systems should
operate, representing the highest level of systemic identity and purpose.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity provides limited explanatory power, functioning more as a
broad umbrella term than illuminating specific mechanisms or structural relations
that Smith identifies in colonial economic arrangements.
---
# Evaluation: Colony Economic System Principles
## definition_precision — 2.0 / 5.0
The definition is vague and circular, essentially saying "principles that underlie colonial economic arrangements should be based on principles of natural liberty." It doesn't clearly distinguish what makes these principles specifically about colonies versus general economic principles.
## source_grounding — 3.0 / 5.0
While Smith does discuss colonial policy and advocates for free trade over mercantilism in Book V, the entity appears to abstract his specific arguments into a generalized concept of "colony economic system principles" that may not reflect how Smith actually structured his analysis.
## domain_placement — 4.0 / 5.0
The "Regulation" domain placement is appropriate since Smith's colonial discussions in Book V focus heavily on regulatory frameworks, trade restrictions, and government policies affecting colonial commerce.
## vsm_relevance — 5.0 / 5.0
This entity maps clearly to S5 (identity/policy) as it deals with fundamental principles and policy frameworks that define how colonial economic systems should operate, representing the highest level of systemic identity and purpose.
## explanatory_value — 2.0 / 5.0
The entity provides limited explanatory power, functioning more as a broad umbrella term than illuminating specific mechanisms or structural relations that Smith identifies in colonial economic arrangements.