feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: retaliation_in_trade_policy
evaluator: null
evaluated_at: '2026-02-23T06:18:20.448225'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes retaliation from other trade policies
by emphasizing the reactive, revenge-motivated nature and the cyclical harm it
creates. It captures a distinct behavioral pattern in trade policy rather than
being a vague umbrella term.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual analysis in Book IV, Chapter
2, where he explicitly discusses French-English trade restrictions and argues
against retaliatory measures except when they might lead to beneficial policy
changes. The concept directly reflects Smith's reasoning about the counterproductive
nature of revenge-based trade policy.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain is perfectly appropriate since retaliation in
trade policy is fundamentally about how nations regulate and restrict trade flows
in response to each other's regulatory actions. This is clearly a regulatory mechanism
rather than belonging to production, exchange, or distribution domains.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents how nations respond to external trade policy environments, and potentially
S2 (coordination) as it involves managing relationships between trading partners.
The reactive, adaptive nature makes it highly relevant to VSM thinking about system
responses.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: "The entity illuminates an important mechanism in international trade\
\ relations\u2014how reactive policies can create destructive cycles\u2014and\
\ provides insight into the structural dynamics between nations' trade policies.\
\ It goes beyond merely naming a phenomenon to explain a causal pattern that Smith\
\ identified as economically significant."
---
# Evaluation: Retaliation In Trade Policy
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes retaliation from other trade policies by emphasizing the reactive, revenge-motivated nature and the cyclical harm it creates. It captures a distinct behavioral pattern in trade policy rather than being a vague umbrella term.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 2, where he explicitly discusses French-English trade restrictions and argues against retaliatory measures except when they might lead to beneficial policy changes. The concept directly reflects Smith's reasoning about the counterproductive nature of revenge-based trade policy.
## domain_placement — 5.0 / 5.0
The "Regulation" domain is perfectly appropriate since retaliation in trade policy is fundamentally about how nations regulate and restrict trade flows in response to each other's regulatory actions. This is clearly a regulatory mechanism rather than belonging to production, exchange, or distribution domains.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents how nations respond to external trade policy environments, and potentially S2 (coordination) as it involves managing relationships between trading partners. The reactive, adaptive nature makes it highly relevant to VSM thinking about system responses.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important mechanism in international trade relations—how reactive policies can create destructive cycles—and provides insight into the structural dynamics between nations' trade policies. It goes beyond merely naming a phenomenon to explain a causal pattern that Smith identified as economically significant.