feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: economic_system_transition_challenges
evaluator: null
evaluated_at: '2026-02-23T05:21:56.042203'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about systemic economic change
but remains somewhat broad, encompassing multiple distinct phenomena (institutional
changes, adjustment costs, resistance) without clearly delineating their relationships.
While not circular, it could be more precise about what specifically constitutes
a "transition challenge."
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does explicitly discuss the difficulties of moving away from mercantilist
policies and the resistance such changes would face from established interests
in Book IV. The concept is well-grounded in his analysis of why harmful economic
policies persist despite their inefficiency.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this concept
spans multiple specific economic areas and represents a meta-level consideration
about how economic systems change over time. It''s not specific to trade, production,
or any particular economic sector.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it concerns how economic systems adapt to new information and changing conditions,
and to S5 (identity/policy) regarding fundamental systemic changes. The transition
challenges represent key cybernetic concerns about system evolution.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by identifying why economic
reforms face systematic obstacles beyond mere policy disagreement, illuminating
the structural and institutional mechanisms that create inertia in economic systems.
This helps explain the persistence of suboptimal economic arrangements.
---
# Evaluation: Economic System Transition Challenges
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about systemic economic change but remains somewhat broad, encompassing multiple distinct phenomena (institutional changes, adjustment costs, resistance) without clearly delineating their relationships. While not circular, it could be more precise about what specifically constitutes a "transition challenge."
## source_grounding — 4.0 / 5.0
Smith does explicitly discuss the difficulties of moving away from mercantilist policies and the resistance such changes would face from established interests in Book IV. The concept is well-grounded in his analysis of why harmful economic policies persist despite their inefficiency.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this concept spans multiple specific economic areas and represents a meta-level consideration about how economic systems change over time. It's not specific to trade, production, or any particular economic sector.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to new information and changing conditions, and to S5 (identity/policy) regarding fundamental systemic changes. The transition challenges represent key cybernetic concerns about system evolution.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by identifying why economic reforms face systematic obstacles beyond mere policy disagreement, illuminating the structural and institutional mechanisms that create inertia in economic systems. This helps explain the persistence of suboptimal economic arrangements.