Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_system_resilience

null

2026-02-23T04:50:06.344873

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about economic adaptability, but "resilience" is somewhat broad and could encompass various mechanisms. The connection between openness and resilience is stated but not precisely delineated in terms of specific causal pathways.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does critique monopolistic colonial arrangements and advocates for freer trade, the specific framing of "resilience" as a systemic property is more of a modern economic concept overlaid onto Smith's arguments. Smith focuses more on efficiency and natural liberty than on resilience per se.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since this concept spans multiple aspects of Smith's economic thinking about colonial arrangements, trade policy, and market structures. It's not confined to a single narrow economic mechanism.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to external shocks and changing conditions. It also touches on S2 (coordination) regarding how open vs. closed systems manage oscillations and disruptions.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The concept does illuminate why Smith favors open over monopolistic colonial arrangements by highlighting adaptive capacity, but it remains somewhat abstract. It provides a useful lens for understanding Smith's arguments but doesn't reveal deeply specific mechanisms.

Evaluation: Colonial Economic System Resilience

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about economic adaptability, but "resilience" is somewhat broad and could encompass various mechanisms. The connection between openness and resilience is stated but not precisely delineated in terms of specific causal pathways.

source_grounding — 2.0 / 5.0

While Smith does critique monopolistic colonial arrangements and advocates for freer trade, the specific framing of "resilience" as a systemic property is more of a modern economic concept overlaid onto Smith's arguments. Smith focuses more on efficiency and natural liberty than on resilience per se.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since this concept spans multiple aspects of Smith's economic thinking about colonial arrangements, trade policy, and market structures. It's not confined to a single narrow economic mechanism.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems adapt to external shocks and changing conditions. It also touches on S2 (coordination) regarding how open vs. closed systems manage oscillations and disruptions.

explanatory_value — 3.0 / 5.0

The concept does illuminate why Smith favors open over monopolistic colonial arrangements by highlighting adaptive capacity, but it remains somewhat abstract. It provides a useful lens for understanding Smith's arguments but doesn't reveal deeply specific mechanisms.

3.4 KiB Raw Blame History