Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_system_objectives

null

2026-02-23T04:49:29.268516

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition identifies distinct categories of objectives (economic development, revenue generation, political control, mutual benefit) but remains somewhat broad and umbrella-like. While it avoids circularity, it could be more precise about what constitutes "more open systems" versus "restrictive monopoly arrangements."

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity accurately reflects Smith's analysis in Book IV, Chapter 7, where he explicitly examines different colonial policy approaches and argues that monopolistic systems fail to achieve their stated objectives. The contrast between restrictive and open arrangements is well-grounded in Smith's text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain placement is highly appropriate, as this entity deals with policy objectives and regulatory approaches to colonial management. It fits naturally within the broader regulatory framework that Smith analyzes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S5 (identity/policy) as it deals with high-level objectives and policy direction for colonial systems. It also has relevance to S4 (intelligence/adaptation) in terms of how different approaches respond to environmental conditions and achieve strategic goals.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating the structural relationship between policy approaches and their effectiveness in achieving stated objectives. It helps explain why Smith advocates for more open colonial arrangements over monopolistic ones.

Evaluation: Colonial Economic System Objectives

definition_precision — 3.0 / 5.0

The definition identifies distinct categories of objectives (economic development, revenue generation, political control, mutual benefit) but remains somewhat broad and umbrella-like. While it avoids circularity, it could be more precise about what constitutes "more open systems" versus "restrictive monopoly arrangements."

source_grounding — 4.0 / 5.0

This entity accurately reflects Smith's analysis in Book IV, Chapter 7, where he explicitly examines different colonial policy approaches and argues that monopolistic systems fail to achieve their stated objectives. The contrast between restrictive and open arrangements is well-grounded in Smith's text.

domain_placement — 5.0 / 5.0

The "Regulation" domain placement is highly appropriate, as this entity deals with policy objectives and regulatory approaches to colonial management. It fits naturally within the broader regulatory framework that Smith analyzes.

vsm_relevance — 4.0 / 5.0

This entity maps well to S5 (identity/policy) as it deals with high-level objectives and policy direction for colonial systems. It also has relevance to S4 (intelligence/adaptation) in terms of how different approaches respond to environmental conditions and achieve strategic goals.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating the structural relationship between policy approaches and their effectiveness in achieving stated objectives. It helps explain why Smith advocates for more open colonial arrangements over monopolistic ones.

3.5 KiB Raw Blame History