feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: colonial_economic_policy_alternatives
evaluator: null
evaluated_at: '2026-02-23T04:46:44.001592'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a distinct concept about different approaches
to colonial economic management, but it remains somewhat vague with phrases like
"varying degrees of economic freedom" without specifying what these alternatives
actually entail. It avoids circularity but lacks the precision needed to clearly
distinguish between different policy options.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity appears well-grounded in Smith's actual discussion in Book
IV, Chapter 7, where he explicitly examines different approaches to colonial policy
and critiques the monopoly system. The concept directly reflects Smith's comparative
analysis of policy alternatives rather than imposing external frameworks.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is highly appropriate, as this entity
deals specifically with different regulatory approaches and policy frameworks
for managing colonial economic relationships. This is fundamentally about regulatory
choices rather than market mechanisms or production processes.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents different strategic approaches to managing colonial relationships
based on environmental feedback and learning. It also has relevance to S5 (identity/policy)
as these alternatives reflect different policy philosophies about the proper relationship
between mother country and colonies.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory value by highlighting that Smith's
critique of mercantilism includes constructive alternatives, not just criticism.
It illuminates the structural relationship between policy choice and economic
outcomes, showing how different regulatory approaches can produce different systemic
results.
---
# Evaluation: Colonial Economic Policy Alternatives
## definition_precision — 3.0 / 5.0
The definition captures a distinct concept about different approaches to colonial economic management, but it remains somewhat vague with phrases like "varying degrees of economic freedom" without specifying what these alternatives actually entail. It avoids circularity but lacks the precision needed to clearly distinguish between different policy options.
## source_grounding — 4.0 / 5.0
This entity appears well-grounded in Smith's actual discussion in Book IV, Chapter 7, where he explicitly examines different approaches to colonial policy and critiques the monopoly system. The concept directly reflects Smith's comparative analysis of policy alternatives rather than imposing external frameworks.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is highly appropriate, as this entity deals specifically with different regulatory approaches and policy frameworks for managing colonial economic relationships. This is fundamentally about regulatory choices rather than market mechanisms or production processes.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents different strategic approaches to managing colonial relationships based on environmental feedback and learning. It also has relevance to S5 (identity/policy) as these alternatives reflect different policy philosophies about the proper relationship between mother country and colonies.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory value by highlighting that Smith's critique of mercantilism includes constructive alternatives, not just criticism. It illuminates the structural relationship between policy choice and economic outcomes, showing how different regulatory approaches can produce different systemic results.