feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: colonial_economic_system_sustainability
evaluator: null
evaluated_at: '2026-02-23T04:50:24.574577'
overall_score: 3.8
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a reasonably distinct concept about long-term
viability of colonial systems, but uses somewhat vague terms like "unsustainable
dependencies" and "more open systems" without precise specification. The contrast
between monopoly and open arrangements provides some clarity but could be more
operationally defined.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual arguments from Book IV,
Chapter 7, where he explicitly critiques monopoly-based colonial systems as creating
inefficiencies and argues for more open arrangements. The characterization accurately
reflects Smith's position on colonial economic policy sustainability.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate as this entity addresses broad principles
about economic system design and sustainability that extend beyond specific colonial
contexts. It represents a theoretical insight about institutional arrangements
rather than a narrow empirical observation.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to VSM System 4 (intelligence/environmental adaptation)
as it concerns how colonial systems adapt to changing conditions and maintain
viability over time. It also touches on System 5 (identity/policy) regarding fundamental
organizational design choices between monopoly and open approaches.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: "The entity illuminates an important structural mechanism in Smith's\
\ theory\u2014how institutional design (monopoly vs. openness) affects long-term\
\ system viability through feedback effects on efficiency and political stability.\
\ This provides genuine insight into the dynamics of economic system sustainability\
\ rather than merely labeling a phenomenon."
---
# Evaluation: Colonial Economic System Sustainability
## definition_precision — 3.0 / 5.0
The definition captures a reasonably distinct concept about long-term viability of colonial systems, but uses somewhat vague terms like "unsustainable dependencies" and "more open systems" without precise specification. The contrast between monopoly and open arrangements provides some clarity but could be more operationally defined.
## source_grounding — 4.0 / 5.0
This entity is well-grounded in Smith's actual arguments from Book IV, Chapter 7, where he explicitly critiques monopoly-based colonial systems as creating inefficiencies and argues for more open arrangements. The characterization accurately reflects Smith's position on colonial economic policy sustainability.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate as this entity addresses broad principles about economic system design and sustainability that extend beyond specific colonial contexts. It represents a theoretical insight about institutional arrangements rather than a narrow empirical observation.
## vsm_relevance — 4.0 / 5.0
This entity maps well to VSM System 4 (intelligence/environmental adaptation) as it concerns how colonial systems adapt to changing conditions and maintain viability over time. It also touches on System 5 (identity/policy) regarding fundamental organizational design choices between monopoly and open approaches.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important structural mechanism in Smith's theory—how institutional design (monopoly vs. openness) affects long-term system viability through feedback effects on efficiency and political stability. This provides genuine insight into the dynamics of economic system sustainability rather than merely labeling a phenomenon.