feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,68 @@
---
entity_slug: colony_economic_system_relationship
evaluator: null
evaluated_at: '2026-02-23T04:55:41.102837'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a distinct concept about colonial-metropolitan
economic relationships, but it's somewhat vague in describing what constitutes
"mutual benefit" and "free trade principles." The contrast with "monopolistic
control" helps clarify the concept but could be more precise about the specific
mechanisms involved.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual analysis in Book V, Chapter
3, where he extensively critiques the mercantile system's approach to colonial
management and advocates for freer trade relationships. Smith does explicitly
argue against monopolistic colonial policies and for more mutually beneficial
arrangements.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate for this entity, as it
fundamentally concerns trade relationships, commercial policies, and the flow
of goods between different economic territories. This is clearly about exchange
mechanisms rather than production, distribution, or consumption per se.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it concerns how economic systems should adapt their relationships with external
environments (colonies), and potentially S5 (policy/identity) regarding fundamental
policy choices about colonial governance. The strategic nature of colonial relationships
fits naturally within VSM thinking.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: "This entity provides genuine explanatory power by illuminating the structural\
\ mechanism through which Smith believes colonial relationships should operate\u2014\
moving from extractive monopoly to mutual exchange. It helps explain a key component\
\ of Smith's critique of mercantilism and his alternative vision for international\
\ economic relations."
---
# Evaluation: Colony Economic System Relationship
## definition_precision — 3.0 / 5.0
The definition captures a distinct concept about colonial-metropolitan economic relationships, but it's somewhat vague in describing what constitutes "mutual benefit" and "free trade principles." The contrast with "monopolistic control" helps clarify the concept but could be more precise about the specific mechanisms involved.
## source_grounding — 4.0 / 5.0
This entity is well-grounded in Smith's actual analysis in Book V, Chapter 3, where he extensively critiques the mercantile system's approach to colonial management and advocates for freer trade relationships. Smith does explicitly argue against monopolistic colonial policies and for more mutually beneficial arrangements.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate for this entity, as it fundamentally concerns trade relationships, commercial policies, and the flow of goods between different economic territories. This is clearly about exchange mechanisms rather than production, distribution, or consumption per se.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems should adapt their relationships with external environments (colonies), and potentially S5 (policy/identity) regarding fundamental policy choices about colonial governance. The strategic nature of colonial relationships fits naturally within VSM thinking.
## explanatory_value — 4.0 / 5.0
This entity provides genuine explanatory power by illuminating the structural mechanism through which Smith believes colonial relationships should operate—moving from extractive monopoly to mutual exchange. It helps explain a key component of Smith's critique of mercantilism and his alternative vision for international economic relations.