Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mercantile_system

null

2026-02-23T05:50:58.790197

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies the mercantile system's core tenets: export promotion, import restriction, wealth as precious metals accumulation, and favorable trade balance as prosperity driver. It avoids circularity and captures a distinct economic doctrine with specific policy implications.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, particularly Book IV where he extensively analyzes and critiques mercantilism as the dominant economic thinking of his era. Smith explicitly discusses mercantile principles and their influence on policy throughout multiple chapters.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since mercantilism represents a comprehensive economic worldview that Smith systematically examines and refutes. It could potentially fit in a trade policy domain, but its theoretical scope justifies the current placement.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	The mercantile system maps primarily to S4 (intelligence/environmental adaptation) as it represents a flawed model for understanding economic environment and trade relationships. It also touches S5 (policy/identity) in shaping national economic identity, making it moderately relevant to VSM analysis.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides exceptional explanatory power by identifying the intellectual foundation underlying the trade policies Smith criticizes. Understanding mercantilism is essential for grasping Smith's arguments about free trade, comparative advantage, and the nature of wealth creation.

Evaluation: Mercantile System

definition_precision — 4.0 / 5.0

The definition clearly identifies the mercantile system's core tenets: export promotion, import restriction, wealth as precious metals accumulation, and favorable trade balance as prosperity driver. It avoids circularity and captures a distinct economic doctrine with specific policy implications.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, particularly Book IV where he extensively analyzes and critiques mercantilism as the dominant economic thinking of his era. Smith explicitly discusses mercantile principles and their influence on policy throughout multiple chapters.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since mercantilism represents a comprehensive economic worldview that Smith systematically examines and refutes. It could potentially fit in a trade policy domain, but its theoretical scope justifies the current placement.

vsm_relevance — 3.0 / 5.0

The mercantile system maps primarily to S4 (intelligence/environmental adaptation) as it represents a flawed model for understanding economic environment and trade relationships. It also touches S5 (policy/identity) in shaping national economic identity, making it moderately relevant to VSM analysis.

explanatory_value — 5.0 / 5.0

This entity provides exceptional explanatory power by identifying the intellectual foundation underlying the trade policies Smith criticizes. Understanding mercantilism is essential for grasping Smith's arguments about free trade, comparative advantage, and the nature of wealth creation.

3.5 KiB Raw Blame History