feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: colony_economic_system_design
evaluator: null
evaluated_at: '2026-02-23T04:53:26.998428'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a distinct concept about metropolitan authorities
structuring colonial economies, but uses somewhat vague terms like "intentional
structuring" and "economic arrangements" that could be more precise. It does avoid
circularity and distinguishes this from general colonial policy.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual critique of British colonial
economic policy in Book V, Chapter 3, where he extensively discusses how mercantilist
principles shaped colonial trade regulations. The characterization of Smith's
criticism as focusing on outdated mercantilist principles versus sound economic
reasoning accurately reflects the source text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is highly appropriate, as this entity
specifically concerns how metropolitan authorities regulate and structure colonial
economic systems through policy design. This is fundamentally about regulatory
frameworks rather than trade, production, or other economic domains.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to VSM System 3 (internal regulation) and System
5 (identity/policy), as it involves both the regulatory mechanisms imposed on
colonies and the policy decisions that reflect the metropolitan power's economic
identity and principles. The design aspect also touches on System 4 (intelligence/adaptation),
though Smith argues this adaptation is flawed.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides strong explanatory value by illuminating the structural
mechanism through which mercantilist principles become embedded in colonial economic
systems through deliberate design choices. It helps explain why colonial economies
often functioned suboptimally according to Smith's analysis, rather than merely
describing surface-level policies.
---
# Evaluation: Colony Economic System Design
## definition_precision — 3.0 / 5.0
The definition captures a distinct concept about metropolitan authorities structuring colonial economies, but uses somewhat vague terms like "intentional structuring" and "economic arrangements" that could be more precise. It does avoid circularity and distinguishes this from general colonial policy.
## source_grounding — 4.0 / 5.0
This entity is well-grounded in Smith's actual critique of British colonial economic policy in Book V, Chapter 3, where he extensively discusses how mercantilist principles shaped colonial trade regulations. The characterization of Smith's criticism as focusing on outdated mercantilist principles versus sound economic reasoning accurately reflects the source text.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is highly appropriate, as this entity specifically concerns how metropolitan authorities regulate and structure colonial economic systems through policy design. This is fundamentally about regulatory frameworks rather than trade, production, or other economic domains.
## vsm_relevance — 4.0 / 5.0
This entity maps well to VSM System 3 (internal regulation) and System 5 (identity/policy), as it involves both the regulatory mechanisms imposed on colonies and the policy decisions that reflect the metropolitan power's economic identity and principles. The design aspect also touches on System 4 (intelligence/adaptation), though Smith argues this adaptation is flawed.
## explanatory_value — 4.0 / 5.0
This entity provides strong explanatory value by illuminating the structural mechanism through which mercantilist principles become embedded in colonial economic systems through deliberate design choices. It helps explain why colonial economies often functioned suboptimally according to Smith's analysis, rather than merely describing surface-level policies.