Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_stability

null

2026-02-23T04:47:18.526839

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept of economic resilience but is somewhat broad, encompassing multiple related phenomena (growth consistency, market management, adaptability). While not circular, it could be more precise about what specifically constitutes "stability" versus other economic outcomes.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual arguments about colonial monopolies creating artificial dependencies and limiting adaptive capacity. The connection between economic freedom, diversification, and stability reflects Smith's explicit reasoning about the negative effects of restrictive colonial policies.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this entity represents a broad theoretical principle about the relationship between economic freedom and stability that applies across Smith's analysis. It's not specific to particular mechanisms but rather a general economic principle.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 4 (intelligence/environmental adaptation) as it concerns an economy's ability to adapt to changing conditions and external shocks. It also relates to System 2 (anti-oscillation) through its focus on managing market fluctuations and maintaining stability.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating the structural relationship between economic freedom, diversification, and systemic resilience. It helps explain why Smith advocates against monopolistic colonial arrangements by showing the stability benefits of more open economic systems.

Evaluation: Colonial Economic Stability

definition_precision — 3.0 / 5.0

The definition captures a coherent concept of economic resilience but is somewhat broad, encompassing multiple related phenomena (growth consistency, market management, adaptability). While not circular, it could be more precise about what specifically constitutes "stability" versus other economic outcomes.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual arguments about colonial monopolies creating artificial dependencies and limiting adaptive capacity. The connection between economic freedom, diversification, and stability reflects Smith's explicit reasoning about the negative effects of restrictive colonial policies.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this entity represents a broad theoretical principle about the relationship between economic freedom and stability that applies across Smith's analysis. It's not specific to particular mechanisms but rather a general economic principle.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 4 (intelligence/environmental adaptation) as it concerns an economy's ability to adapt to changing conditions and external shocks. It also relates to System 2 (anti-oscillation) through its focus on managing market fluctuations and maintaining stability.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating the structural relationship between economic freedom, diversification, and systemic resilience. It helps explain why Smith advocates against monopolistic colonial arrangements by showing the stability benefits of more open economic systems.

3.7 KiB Raw Blame History