Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

national_animosity_in_commerce

null

2026-02-23T05:56:41.816184

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes national animosity from other trade concepts by focusing on hostile attitudes that frame trade as warfare rather than mutual benefit. It avoids circularity and identifies specific manifestations like retaliatory restrictions and harm-focused policies.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book IV, Chapter 3, where he explicitly discusses how nationalistic hostility drives irrational trade policies. Smith clearly identifies animosity between nations as a key factor that merchants exploit to secure protections.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is perfectly appropriate since this concept deals with how emotional and political factors influence the creation of trade regulations and barriers. It captures the non-economic drivers behind regulatory policy formation.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S4 (intelligence/environmental adaptation) as it represents a dysfunction in how nations perceive and respond to their trading environment, treating partners as threats rather than opportunities. It could also relate to S5 (identity/policy) regarding national identity formation.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by identifying a key psychological and political mechanism that drives economically irrational trade policies. It explains why nations often adopt self-defeating protectionist measures despite clear economic evidence against them.

Evaluation: National Animosity In Commerce

definition_precision — 4.0 / 5.0

The definition clearly distinguishes national animosity from other trade concepts by focusing on hostile attitudes that frame trade as warfare rather than mutual benefit. It avoids circularity and identifies specific manifestations like retaliatory restrictions and harm-focused policies.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book IV, Chapter 3, where he explicitly discusses how nationalistic hostility drives irrational trade policies. Smith clearly identifies animosity between nations as a key factor that merchants exploit to secure protections.

domain_placement — 5.0 / 5.0

The "Regulation" domain is perfectly appropriate since this concept deals with how emotional and political factors influence the creation of trade regulations and barriers. It captures the non-economic drivers behind regulatory policy formation.

vsm_relevance — 4.0 / 5.0

This maps well to S4 (intelligence/environmental adaptation) as it represents a dysfunction in how nations perceive and respond to their trading environment, treating partners as threats rather than opportunities. It could also relate to S5 (identity/policy) regarding national identity formation.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by identifying a key psychological and political mechanism that drives economically irrational trade policies. It explains why nations often adopt self-defeating protectionist measures despite clear economic evidence against them.

3.5 KiB Raw Blame History