Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_resilience

null

2026-02-23T04:55:50.590531

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about economic adaptability, but uses somewhat vague terms like "withstand," "recover," and "maintain prosperity" without clear operational criteria. It's not circular but could be more precise about what constitutes resilience versus mere survival.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss colonial economic policies and their effects, the specific concept of "resilience" as defined here appears to be a modern analytical framework imposed on his work rather than a concept he explicitly develops. The context statement makes claims about Smith's arguments that may be interpretive rather than directly textual.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Accumulation" domain is appropriate since colonial economic resilience relates to the capacity for sustained wealth generation and capital formation over time. This fits well with Smith's broader concerns about economic growth and development.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it specifically concerns how colonial economies adapt to changing external conditions and environmental challenges. It also touches on S3 (internal regulation) regarding the capacity to maintain stability.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The concept provides some analytical value by highlighting the relationship between economic freedom and adaptive capacity in colonial contexts. However, it remains somewhat abstract and doesn't clearly illuminate specific mechanisms that Smith identifies for how this resilience actually operates.

Evaluation: Colony Economic System Resilience

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about economic adaptability, but uses somewhat vague terms like "withstand," "recover," and "maintain prosperity" without clear operational criteria. It's not circular but could be more precise about what constitutes resilience versus mere survival.

source_grounding — 2.0 / 5.0

While Smith does discuss colonial economic policies and their effects, the specific concept of "resilience" as defined here appears to be a modern analytical framework imposed on his work rather than a concept he explicitly develops. The context statement makes claims about Smith's arguments that may be interpretive rather than directly textual.

domain_placement — 4.0 / 5.0

The "Accumulation" domain is appropriate since colonial economic resilience relates to the capacity for sustained wealth generation and capital formation over time. This fits well with Smith's broader concerns about economic growth and development.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it specifically concerns how colonial economies adapt to changing external conditions and environmental challenges. It also touches on S3 (internal regulation) regarding the capacity to maintain stability.

explanatory_value — 3.0 / 5.0

The concept provides some analytical value by highlighting the relationship between economic freedom and adaptive capacity in colonial contexts. However, it remains somewhat abstract and doesn't clearly illuminate specific mechanisms that Smith identifies for how this resilience actually operates.

3.6 KiB Raw Blame History