feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,68 @@
|
||||
---
|
||||
entity_slug: colony_economic_system_relationship
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T04:55:41.102837'
|
||||
overall_score: 4.0
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: The definition captures a distinct concept about colonial-metropolitan
|
||||
economic relationships, but it's somewhat vague in describing what constitutes
|
||||
"mutual benefit" and "free trade principles." The contrast with "monopolistic
|
||||
control" helps clarify the concept but could be more precise about the specific
|
||||
mechanisms involved.
|
||||
- name: source_grounding
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is well-grounded in Smith's actual analysis in Book V, Chapter
|
||||
3, where he extensively critiques the mercantile system's approach to colonial
|
||||
management and advocates for freer trade relationships. Smith does explicitly
|
||||
argue against monopolistic colonial policies and for more mutually beneficial
|
||||
arrangements.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Exchange" domain is perfectly appropriate for this entity, as it
|
||||
fundamentally concerns trade relationships, commercial policies, and the flow
|
||||
of goods between different economic territories. This is clearly about exchange
|
||||
mechanisms rather than production, distribution, or consumption per se.
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
|
||||
it concerns how economic systems should adapt their relationships with external
|
||||
environments (colonies), and potentially S5 (policy/identity) regarding fundamental
|
||||
policy choices about colonial governance. The strategic nature of colonial relationships
|
||||
fits naturally within VSM thinking.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: "This entity provides genuine explanatory power by illuminating the structural\
|
||||
\ mechanism through which Smith believes colonial relationships should operate\u2014\
|
||||
moving from extractive monopoly to mutual exchange. It helps explain a key component\
|
||||
\ of Smith's critique of mercantilism and his alternative vision for international\
|
||||
\ economic relations."
|
||||
---
|
||||
|
||||
# Evaluation: Colony Economic System Relationship
|
||||
|
||||
## definition_precision — 3.0 / 5.0
|
||||
|
||||
The definition captures a distinct concept about colonial-metropolitan economic relationships, but it's somewhat vague in describing what constitutes "mutual benefit" and "free trade principles." The contrast with "monopolistic control" helps clarify the concept but could be more precise about the specific mechanisms involved.
|
||||
|
||||
## source_grounding — 4.0 / 5.0
|
||||
|
||||
This entity is well-grounded in Smith's actual analysis in Book V, Chapter 3, where he extensively critiques the mercantile system's approach to colonial management and advocates for freer trade relationships. Smith does explicitly argue against monopolistic colonial policies and for more mutually beneficial arrangements.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Exchange" domain is perfectly appropriate for this entity, as it fundamentally concerns trade relationships, commercial policies, and the flow of goods between different economic territories. This is clearly about exchange mechanisms rather than production, distribution, or consumption per se.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how economic systems should adapt their relationships with external environments (colonies), and potentially S5 (policy/identity) regarding fundamental policy choices about colonial governance. The strategic nature of colonial relationships fits naturally within VSM thinking.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
This entity provides genuine explanatory power by illuminating the structural mechanism through which Smith believes colonial relationships should operate—moving from extractive monopoly to mutual exchange. It helps explain a key component of Smith's critique of mercantilism and his alternative vision for international economic relations.
|
||||
Reference in New Issue
Block a user