Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

retaliation_in_trade_policy

null

2026-02-23T06:18:20.448225

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes retaliation from other trade policies by emphasizing the reactive, revenge-motivated nature and the cyclical harm it creates. It captures a distinct behavioral pattern in trade policy rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 2, where he explicitly discusses French-English trade restrictions and argues against retaliatory measures except when they might lead to beneficial policy changes. The concept directly reflects Smith's reasoning about the counterproductive nature of revenge-based trade policy.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate since retaliation in trade policy is fundamentally about how nations regulate and restrict trade flows in response to each other's regulatory actions. This is clearly a regulatory mechanism rather than belonging to production, exchange, or distribution domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents how nations respond to external trade policy environments, and potentially S2 (coordination) as it involves managing relationships between trading partners. The reactive, adaptive nature makes it highly relevant to VSM thinking about system responses.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism in international trade relations—how reactive policies can create destructive cycles—and provides insight into the structural dynamics between nations' trade policies. It goes beyond merely naming a phenomenon to explain a causal pattern that Smith identified as economically significant.

Evaluation: Retaliation In Trade Policy

definition_precision — 4.0 / 5.0

The definition clearly distinguishes retaliation from other trade policies by emphasizing the reactive, revenge-motivated nature and the cyclical harm it creates. It captures a distinct behavioral pattern in trade policy rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book IV, Chapter 2, where he explicitly discusses French-English trade restrictions and argues against retaliatory measures except when they might lead to beneficial policy changes. The concept directly reflects Smith's reasoning about the counterproductive nature of revenge-based trade policy.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate since retaliation in trade policy is fundamentally about how nations regulate and restrict trade flows in response to each other's regulatory actions. This is clearly a regulatory mechanism rather than belonging to production, exchange, or distribution domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents how nations respond to external trade policy environments, and potentially S2 (coordination) as it involves managing relationships between trading partners. The reactive, adaptive nature makes it highly relevant to VSM thinking about system responses.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism in international trade relations—how reactive policies can create destructive cycles—and provides insight into the structural dynamics between nations' trade policies. It goes beyond merely naming a phenomenon to explain a causal pattern that Smith identified as economically significant.

3.9 KiB Raw Blame History