Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

national_prejudice_in_trade

null

2026-02-23T05:57:35.890242

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes national prejudice from rational economic considerations and specifies its effects on resource allocation. It could be slightly more precise about what constitutes "nationalistic rather than economic considerations" but captures a distinct concept well.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is thoroughly grounded in Smith's text, particularly in Book IV where he extensively critiques the "prejudices" and "jealousy of trade" that drive mercantile policies. Smith explicitly argues that such prejudices lead nations to adopt harmful protectionist measures.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement since national prejudice manifests primarily through regulatory mechanisms like tariffs, quotas, and trade restrictions. This is fundamentally about how governments regulate commerce based on biased reasoning.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents flawed intelligence gathering and interpretation about foreign trade relationships. It also connects to S5 (identity/policy) as national prejudice shapes fundamental policy orientations toward other nations.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides strong explanatory power by identifying the psychological and ideological mechanism behind protectionist policies that Smith critiques. It explains why economically harmful policies persist despite their negative effects on national wealth.

Evaluation: National Prejudice In Trade

definition_precision — 4.0 / 5.0

The definition clearly distinguishes national prejudice from rational economic considerations and specifies its effects on resource allocation. It could be slightly more precise about what constitutes "nationalistic rather than economic considerations" but captures a distinct concept well.

source_grounding — 5.0 / 5.0

This concept is thoroughly grounded in Smith's text, particularly in Book IV where he extensively critiques the "prejudices" and "jealousy of trade" that drive mercantile policies. Smith explicitly argues that such prejudices lead nations to adopt harmful protectionist measures.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement since national prejudice manifests primarily through regulatory mechanisms like tariffs, quotas, and trade restrictions. This is fundamentally about how governments regulate commerce based on biased reasoning.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents flawed intelligence gathering and interpretation about foreign trade relationships. It also connects to S5 (identity/policy) as national prejudice shapes fundamental policy orientations toward other nations.

explanatory_value — 5.0 / 5.0

This entity provides strong explanatory power by identifying the psychological and ideological mechanism behind protectionist policies that Smith critiques. It explains why economically harmful policies persist despite their negative effects on national wealth.

3.4 KiB Raw Blame History