feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: national_prejudice_in_trade
evaluator: null
evaluated_at: '2026-02-23T05:57:35.890242'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes national prejudice from rational
economic considerations and specifies its effects on resource allocation. It could
be slightly more precise about what constitutes "nationalistic rather than economic
considerations" but captures a distinct concept well.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is thoroughly grounded in Smith's text, particularly in
Book IV where he extensively critiques the "prejudices" and "jealousy of trade"
that drive mercantile policies. Smith explicitly argues that such prejudices lead
nations to adopt harmful protectionist measures.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement since national prejudice
manifests primarily through regulatory mechanisms like tariffs, quotas, and trade
restrictions. This is fundamentally about how governments regulate commerce based
on biased reasoning.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents flawed intelligence gathering and interpretation about foreign trade
relationships. It also connects to S5 (identity/policy) as national prejudice
shapes fundamental policy orientations toward other nations.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides strong explanatory power by identifying the psychological
and ideological mechanism behind protectionist policies that Smith critiques.
It explains why economically harmful policies persist despite their negative effects
on national wealth.
---
# Evaluation: National Prejudice In Trade
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes national prejudice from rational economic considerations and specifies its effects on resource allocation. It could be slightly more precise about what constitutes "nationalistic rather than economic considerations" but captures a distinct concept well.
## source_grounding — 5.0 / 5.0
This concept is thoroughly grounded in Smith's text, particularly in Book IV where he extensively critiques the "prejudices" and "jealousy of trade" that drive mercantile policies. Smith explicitly argues that such prejudices lead nations to adopt harmful protectionist measures.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement since national prejudice manifests primarily through regulatory mechanisms like tariffs, quotas, and trade restrictions. This is fundamentally about how governments regulate commerce based on biased reasoning.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents flawed intelligence gathering and interpretation about foreign trade relationships. It also connects to S5 (identity/policy) as national prejudice shapes fundamental policy orientations toward other nations.
## explanatory_value — 5.0 / 5.0
This entity provides strong explanatory power by identifying the psychological and ideological mechanism behind protectionist policies that Smith critiques. It explains why economically harmful policies persist despite their negative effects on national wealth.