Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_transition_challenges

null

2026-02-23T05:21:56.042203

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about systemic economic change but remains somewhat broad, encompassing multiple distinct phenomena (institutional changes, adjustment costs, resistance) without clearly delineating their relationships. While not circular, it could be more precise about what specifically constitutes a "transition challenge."

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does explicitly discuss the difficulties of moving away from mercantilist policies and the resistance such changes would face from established interests in Book IV. The concept is well-grounded in his analysis of why harmful economic policies persist despite their inefficiency.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept spans multiple specific economic areas and represents a meta-level consideration about how economic systems change over time. It's not specific to trade, production, or any particular economic sector.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to new information and changing conditions, and to S5 (identity/policy) regarding fundamental systemic changes. The transition challenges represent key cybernetic concerns about system evolution.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying why economic reforms face systematic obstacles beyond mere policy disagreement, illuminating the structural and institutional mechanisms that create inertia in economic systems. This helps explain the persistence of suboptimal economic arrangements.

Evaluation: Economic System Transition Challenges

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about systemic economic change but remains somewhat broad, encompassing multiple distinct phenomena (institutional changes, adjustment costs, resistance) without clearly delineating their relationships. While not circular, it could be more precise about what specifically constitutes a "transition challenge."

source_grounding — 4.0 / 5.0

Smith does explicitly discuss the difficulties of moving away from mercantilist policies and the resistance such changes would face from established interests in Book IV. The concept is well-grounded in his analysis of why harmful economic policies persist despite their inefficiency.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept spans multiple specific economic areas and represents a meta-level consideration about how economic systems change over time. It's not specific to trade, production, or any particular economic sector.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to new information and changing conditions, and to S5 (identity/policy) regarding fundamental systemic changes. The transition challenges represent key cybernetic concerns about system evolution.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying why economic reforms face systematic obstacles beyond mere policy disagreement, illuminating the structural and institutional mechanisms that create inertia in economic systems. This helps explain the persistence of suboptimal economic arrangements.

3.7 KiB Raw Blame History