Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_objectives

null

2026-02-23T04:54:56.215505

4.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition identifies a distinct concept about colonial policy goals but remains somewhat vague with phrases like "misaligned with actual interests" and "mercantilist misconceptions." It could be more precise about what specific objectives Smith critiques and how they differ from what he considers proper objectives.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity appears well-grounded in Smith's actual critique of colonial policy in Book V, Chapter 3, where he extensively discusses how mercantilist principles guide colonial economic systems in ways that harm both parties. The reference to mercantilist misconceptions aligns with Smith's documented arguments.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate since this entity concerns policy objectives that guide regulatory frameworks for colonial economic systems. This fits perfectly within the regulatory/governance conceptual category.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps clearly to VSM System 5 (identity/policy), as it deals with the fundamental objectives and purposes that define what a colonial economic system is trying to achieve. These objectives represent the highest-level policy decisions that shape all other system operations.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides good explanatory value by highlighting the structural problem that colonial systems are designed around flawed objectives, which helps explain why these systems produce suboptimal outcomes. It illuminates a key mechanism of systemic dysfunction rather than just describing surface phenomena.

Evaluation: Colony Economic System Objectives

definition_precision — 3.0 / 5.0

The definition identifies a distinct concept about colonial policy goals but remains somewhat vague with phrases like "misaligned with actual interests" and "mercantilist misconceptions." It could be more precise about what specific objectives Smith critiques and how they differ from what he considers proper objectives.

source_grounding — 4.0 / 5.0

This entity appears well-grounded in Smith's actual critique of colonial policy in Book V, Chapter 3, where he extensively discusses how mercantilist principles guide colonial economic systems in ways that harm both parties. The reference to mercantilist misconceptions aligns with Smith's documented arguments.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate since this entity concerns policy objectives that guide regulatory frameworks for colonial economic systems. This fits perfectly within the regulatory/governance conceptual category.

vsm_relevance — 5.0 / 5.0

This entity maps clearly to VSM System 5 (identity/policy), as it deals with the fundamental objectives and purposes that define what a colonial economic system is trying to achieve. These objectives represent the highest-level policy decisions that shape all other system operations.

explanatory_value — 4.0 / 5.0

The entity provides good explanatory value by highlighting the structural problem that colonial systems are designed around flawed objectives, which helps explain why these systems produce suboptimal outcomes. It illuminates a key mechanism of systemic dysfunction rather than just describing surface phenomena.

3.6 KiB Raw Blame History