feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,67 @@
|
||||
---
|
||||
entity_slug: retaliation_in_trade_policy
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T06:18:20.448225'
|
||||
overall_score: 4.4
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly distinguishes retaliation from other trade policies
|
||||
by emphasizing the reactive, revenge-motivated nature and the cyclical harm it
|
||||
creates. It captures a distinct behavioral pattern in trade policy rather than
|
||||
being a vague umbrella term.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is well-grounded in Smith's actual analysis in Book IV, Chapter
|
||||
2, where he explicitly discusses French-English trade restrictions and argues
|
||||
against retaliatory measures except when they might lead to beneficial policy
|
||||
changes. The concept directly reflects Smith's reasoning about the counterproductive
|
||||
nature of revenge-based trade policy.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Regulation" domain is perfectly appropriate since retaliation in
|
||||
trade policy is fundamentally about how nations regulate and restrict trade flows
|
||||
in response to each other's regulatory actions. This is clearly a regulatory mechanism
|
||||
rather than belonging to production, exchange, or distribution domains.
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
|
||||
it represents how nations respond to external trade policy environments, and potentially
|
||||
S2 (coordination) as it involves managing relationships between trading partners.
|
||||
The reactive, adaptive nature makes it highly relevant to VSM thinking about system
|
||||
responses.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: "The entity illuminates an important mechanism in international trade\
|
||||
\ relations\u2014how reactive policies can create destructive cycles\u2014and\
|
||||
\ provides insight into the structural dynamics between nations' trade policies.\
|
||||
\ It goes beyond merely naming a phenomenon to explain a causal pattern that Smith\
|
||||
\ identified as economically significant."
|
||||
---
|
||||
|
||||
# Evaluation: Retaliation In Trade Policy
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly distinguishes retaliation from other trade policies by emphasizing the reactive, revenge-motivated nature and the cyclical harm it creates. It captures a distinct behavioral pattern in trade policy rather than being a vague umbrella term.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 2, where he explicitly discusses French-English trade restrictions and argues against retaliatory measures except when they might lead to beneficial policy changes. The concept directly reflects Smith's reasoning about the counterproductive nature of revenge-based trade policy.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Regulation" domain is perfectly appropriate since retaliation in trade policy is fundamentally about how nations regulate and restrict trade flows in response to each other's regulatory actions. This is clearly a regulatory mechanism rather than belonging to production, exchange, or distribution domains.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to S4 (intelligence/environmental adaptation) as it represents how nations respond to external trade policy environments, and potentially S2 (coordination) as it involves managing relationships between trading partners. The reactive, adaptive nature makes it highly relevant to VSM thinking about system responses.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
The entity illuminates an important mechanism in international trade relations—how reactive policies can create destructive cycles—and provides insight into the structural dynamics between nations' trade policies. It goes beyond merely naming a phenomenon to explain a causal pattern that Smith identified as economically significant.
|
||||
Reference in New Issue
Block a user