Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_purpose

null

2026-02-23T04:55:31.619426

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition identifies a clear concept (the purpose of colonial economic arrangements) and distinguishes between mutual benefit versus one-sided advantage. However, it could be more precise about what constitutes "mutual benefit" and how this differs operationally from exploitative arrangements.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity appears well-grounded in Smith's actual arguments about colonial policy in Book V, Chapter 3, where he critiques mercantile colonial systems and advocates for more equitable arrangements. The distinction between mutual benefit and mother country enrichment reflects Smith's documented views.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Regulation" is an appropriate domain placement since this concerns the fundamental organizing principles and policy frameworks governing colonial economic relationships. This is clearly about regulatory philosophy rather than operational mechanics or coordination.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps very naturally to S5 (identity/policy) as it concerns the fundamental purpose and guiding principles that should govern colonial economic systems. It represents the highest-level policy orientation that would cascade down through all other system levels.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by identifying the core tension in colonial economic design between exploitative and mutualistic approaches. It illuminates why certain colonial policies fail or succeed based on their underlying purpose and helps explain Smith's critique of mercantile colonialism.

Evaluation: Colony Economic System Purpose

definition_precision — 3.0 / 5.0

The definition identifies a clear concept (the purpose of colonial economic arrangements) and distinguishes between mutual benefit versus one-sided advantage. However, it could be more precise about what constitutes "mutual benefit" and how this differs operationally from exploitative arrangements.

source_grounding — 4.0 / 5.0

This entity appears well-grounded in Smith's actual arguments about colonial policy in Book V, Chapter 3, where he critiques mercantile colonial systems and advocates for more equitable arrangements. The distinction between mutual benefit and mother country enrichment reflects Smith's documented views.

domain_placement — 4.0 / 5.0

"Regulation" is an appropriate domain placement since this concerns the fundamental organizing principles and policy frameworks governing colonial economic relationships. This is clearly about regulatory philosophy rather than operational mechanics or coordination.

vsm_relevance — 5.0 / 5.0

This entity maps very naturally to S5 (identity/policy) as it concerns the fundamental purpose and guiding principles that should govern colonial economic systems. It represents the highest-level policy orientation that would cascade down through all other system levels.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by identifying the core tension in colonial economic design between exploitative and mutualistic approaches. It illuminates why certain colonial policies fail or succeed based on their underlying purpose and helps explain Smith's critique of mercantile colonialism.

3.6 KiB Raw Blame History