feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: colony_trade_monopoly
evaluator: null
evaluated_at: '2026-02-23T04:56:43.126981'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly delineates the specific mechanisms of colonial
trade monopoly - exclusive control, prohibition of direct trade, port/seasonal
restrictions, and profit extraction channels. It avoids circularity and captures
a distinct institutional arrangement rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's extensive critique of mercantilist
colonial policy in Book IV, Chapter 7, where he systematically analyzes how exclusive
trading privileges distort natural economic development. The definition accurately
reflects Smith's specific arguments about monopoly effects on both colonies and
mother countries.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement as this represents a formal
institutional mechanism that governs trade relationships through legal restrictions
and exclusive privileges. It clearly belongs in the regulatory rather than market
or production categories.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity maps primarily to S3 (internal regulation) as it represents
a control mechanism within the imperial economic system, though it also touches
S4 (intelligence/adaptation) regarding how empires manage external trade relationships.
The mapping is reasonable but not as clear-cut as purely operational or policy
entities.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides substantial explanatory power by illuminating the
specific institutional mechanism through which mercantilist theory was implemented
and how it created systematic distortions in capital allocation and market development.
It reveals the structural relationship between political control and economic
extraction that Smith critiqued.
---
# Evaluation: Colony Trade Monopoly
## definition_precision — 4.0 / 5.0
The definition clearly delineates the specific mechanisms of colonial trade monopoly - exclusive control, prohibition of direct trade, port/seasonal restrictions, and profit extraction channels. It avoids circularity and captures a distinct institutional arrangement rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's extensive critique of mercantilist colonial policy in Book IV, Chapter 7, where he systematically analyzes how exclusive trading privileges distort natural economic development. The definition accurately reflects Smith's specific arguments about monopoly effects on both colonies and mother countries.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement as this represents a formal institutional mechanism that governs trade relationships through legal restrictions and exclusive privileges. It clearly belongs in the regulatory rather than market or production categories.
## vsm_relevance — 3.0 / 5.0
This entity maps primarily to S3 (internal regulation) as it represents a control mechanism within the imperial economic system, though it also touches S4 (intelligence/adaptation) regarding how empires manage external trade relationships. The mapping is reasonable but not as clear-cut as purely operational or policy entities.
## explanatory_value — 5.0 / 5.0
This entity provides substantial explanatory power by illuminating the specific institutional mechanism through which mercantilist theory was implemented and how it created systematic distortions in capital allocation and market development. It reveals the structural relationship between political control and economic extraction that Smith critiqued.