Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_trade_monopoly

null

2026-02-23T04:56:43.126981

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly delineates the specific mechanisms of colonial trade monopoly - exclusive control, prohibition of direct trade, port/seasonal restrictions, and profit extraction channels. It avoids circularity and captures a distinct institutional arrangement rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's extensive critique of mercantilist colonial policy in Book IV, Chapter 7, where he systematically analyzes how exclusive trading privileges distort natural economic development. The definition accurately reflects Smith's specific arguments about monopoly effects on both colonies and mother countries.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement as this represents a formal institutional mechanism that governs trade relationships through legal restrictions and exclusive privileges. It clearly belongs in the regulatory rather than market or production categories.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps primarily to S3 (internal regulation) as it represents a control mechanism within the imperial economic system, though it also touches S4 (intelligence/adaptation) regarding how empires manage external trade relationships. The mapping is reasonable but not as clear-cut as purely operational or policy entities.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by illuminating the specific institutional mechanism through which mercantilist theory was implemented and how it created systematic distortions in capital allocation and market development. It reveals the structural relationship between political control and economic extraction that Smith critiqued.

Evaluation: Colony Trade Monopoly

definition_precision — 4.0 / 5.0

The definition clearly delineates the specific mechanisms of colonial trade monopoly - exclusive control, prohibition of direct trade, port/seasonal restrictions, and profit extraction channels. It avoids circularity and captures a distinct institutional arrangement rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's extensive critique of mercantilist colonial policy in Book IV, Chapter 7, where he systematically analyzes how exclusive trading privileges distort natural economic development. The definition accurately reflects Smith's specific arguments about monopoly effects on both colonies and mother countries.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement as this represents a formal institutional mechanism that governs trade relationships through legal restrictions and exclusive privileges. It clearly belongs in the regulatory rather than market or production categories.

vsm_relevance — 3.0 / 5.0

This entity maps primarily to S3 (internal regulation) as it represents a control mechanism within the imperial economic system, though it also touches S4 (intelligence/adaptation) regarding how empires manage external trade relationships. The mapping is reasonable but not as clear-cut as purely operational or policy entities.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by illuminating the specific institutional mechanism through which mercantilist theory was implemented and how it created systematic distortions in capital allocation and market development. It reveals the structural relationship between political control and economic extraction that Smith critiqued.

3.8 KiB Raw Blame History