Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_design

null

2026-02-23T04:53:26.998428

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about metropolitan authorities structuring colonial economies, but uses somewhat vague terms like "intentional structuring" and "economic arrangements" that could be more precise. It does avoid circularity and distinguishes this from general colonial policy.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual critique of British colonial economic policy in Book V, Chapter 3, where he extensively discusses how mercantilist principles shaped colonial trade regulations. The characterization of Smith's criticism as focusing on outdated mercantilist principles versus sound economic reasoning accurately reflects the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate, as this entity specifically concerns how metropolitan authorities regulate and structure colonial economic systems through policy design. This is fundamentally about regulatory frameworks rather than trade, production, or other economic domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 3 (internal regulation) and System 5 (identity/policy), as it involves both the regulatory mechanisms imposed on colonies and the policy decisions that reflect the metropolitan power's economic identity and principles. The design aspect also touches on System 4 (intelligence/adaptation), though Smith argues this adaptation is flawed.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory value by illuminating the structural mechanism through which mercantilist principles become embedded in colonial economic systems through deliberate design choices. It helps explain why colonial economies often functioned suboptimally according to Smith's analysis, rather than merely describing surface-level policies.

Evaluation: Colony Economic System Design

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about metropolitan authorities structuring colonial economies, but uses somewhat vague terms like "intentional structuring" and "economic arrangements" that could be more precise. It does avoid circularity and distinguishes this from general colonial policy.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual critique of British colonial economic policy in Book V, Chapter 3, where he extensively discusses how mercantilist principles shaped colonial trade regulations. The characterization of Smith's criticism as focusing on outdated mercantilist principles versus sound economic reasoning accurately reflects the source text.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate, as this entity specifically concerns how metropolitan authorities regulate and structure colonial economic systems through policy design. This is fundamentally about regulatory frameworks rather than trade, production, or other economic domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 3 (internal regulation) and System 5 (identity/policy), as it involves both the regulatory mechanisms imposed on colonies and the policy decisions that reflect the metropolitan power's economic identity and principles. The design aspect also touches on System 4 (intelligence/adaptation), though Smith argues this adaptation is flawed.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory value by illuminating the structural mechanism through which mercantilist principles become embedded in colonial economic systems through deliberate design choices. It helps explain why colonial economies often functioned suboptimally according to Smith's analysis, rather than merely describing surface-level policies.

4.1 KiB Raw Blame History