feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: colonial_economic_system_resilience
evaluator: null
evaluated_at: '2026-02-23T04:50:06.344873'
overall_score: 3.2
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about economic adaptability,
but "resilience" is somewhat broad and could encompass various mechanisms. The
connection between openness and resilience is stated but not precisely delineated
in terms of specific causal pathways.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does critique monopolistic colonial arrangements and advocates
for freer trade, the specific framing of "resilience" as a systemic property is
more of a modern economic concept overlaid onto Smith's arguments. Smith focuses
more on efficiency and natural liberty than on resilience per se.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate since this concept spans multiple aspects
of Smith''s economic thinking about colonial arrangements, trade policy, and market
structures. It''s not confined to a single narrow economic mechanism.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it concerns how economic systems adapt to external shocks and changing conditions.
It also touches on S2 (coordination) regarding how open vs. closed systems manage
oscillations and disruptions.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: The concept does illuminate why Smith favors open over monopolistic colonial
arrangements by highlighting adaptive capacity, but it remains somewhat abstract.
It provides a useful lens for understanding Smith's arguments but doesn't reveal
deeply specific mechanisms.
---
# Evaluation: Colonial Economic System Resilience
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about economic adaptability, but "resilience" is somewhat broad and could encompass various mechanisms. The connection between openness and resilience is stated but not precisely delineated in terms of specific causal pathways.
## source_grounding — 2.0 / 5.0
While Smith does critique monopolistic colonial arrangements and advocates for freer trade, the specific framing of "resilience" as a systemic property is more of a modern economic concept overlaid onto Smith's arguments. Smith focuses more on efficiency and natural liberty than on resilience per se.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate since this concept spans multiple aspects of Smith's economic thinking about colonial arrangements, trade policy, and market structures. It's not confined to a single narrow economic mechanism.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to external shocks and changing conditions. It also touches on S2 (coordination) regarding how open vs. closed systems manage oscillations and disruptions.
## explanatory_value — 3.0 / 5.0
The concept does illuminate why Smith favors open over monopolistic colonial arrangements by highlighting adaptive capacity, but it remains somewhat abstract. It provides a useful lens for understanding Smith's arguments but doesn't reveal deeply specific mechanisms.