feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: colony_economic_system_resilience
evaluator: null
evaluated_at: '2026-02-23T04:55:50.590531'
overall_score: 3.2
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about economic adaptability,
but uses somewhat vague terms like "withstand," "recover," and "maintain prosperity"
without clear operational criteria. It's not circular but could be more precise
about what constitutes resilience versus mere survival.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss colonial economic policies and their effects,
the specific concept of "resilience" as defined here appears to be a modern analytical
framework imposed on his work rather than a concept he explicitly develops. The
context statement makes claims about Smith's arguments that may be interpretive
rather than directly textual.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Accumulation" domain is appropriate since colonial economic resilience
relates to the capacity for sustained wealth generation and capital formation
over time. This fits well with Smith's broader concerns about economic growth
and development.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it specifically concerns how colonial economies adapt to changing external conditions
and environmental challenges. It also touches on S3 (internal regulation) regarding
the capacity to maintain stability.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: The concept provides some analytical value by highlighting the relationship
between economic freedom and adaptive capacity in colonial contexts. However,
it remains somewhat abstract and doesn't clearly illuminate specific mechanisms
that Smith identifies for how this resilience actually operates.
---
# Evaluation: Colony Economic System Resilience
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about economic adaptability, but uses somewhat vague terms like "withstand," "recover," and "maintain prosperity" without clear operational criteria. It's not circular but could be more precise about what constitutes resilience versus mere survival.
## source_grounding — 2.0 / 5.0
While Smith does discuss colonial economic policies and their effects, the specific concept of "resilience" as defined here appears to be a modern analytical framework imposed on his work rather than a concept he explicitly develops. The context statement makes claims about Smith's arguments that may be interpretive rather than directly textual.
## domain_placement — 4.0 / 5.0
The "Accumulation" domain is appropriate since colonial economic resilience relates to the capacity for sustained wealth generation and capital formation over time. This fits well with Smith's broader concerns about economic growth and development.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it specifically concerns how colonial economies adapt to changing external conditions and environmental challenges. It also touches on S3 (internal regulation) regarding the capacity to maintain stability.
## explanatory_value — 3.0 / 5.0
The concept provides some analytical value by highlighting the relationship between economic freedom and adaptive capacity in colonial contexts. However, it remains somewhat abstract and doesn't clearly illuminate specific mechanisms that Smith identifies for how this resilience actually operates.