Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

mercantile_system_principles

null

2026-02-23T05:50:49.090129

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies three specific doctrines (precious metals as wealth, zero-sum trade, colonial subordination) that form a coherent ideological framework. While "restrictive trade practices" could be more specific, the core principles are well-delineated and non-circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's extensive critique of mercantile doctrine throughout Book IV, where he systematically examines these exact principles and their policy implications. The definition accurately captures concepts that Smith explicitly discusses and refutes.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain since these principles constitute the theoretical foundation underlying specific mercantile policies rather than particular economic mechanisms or historical events. This represents the ideological superstructure that Smith seeks to dismantle.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S5 (identity/policy) as it represents the fundamental worldview and policy principles that guide mercantile decision-making. It also connects to S4 (intelligence) in terms of how mercantile thinkers interpret economic information through their doctrinal lens.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power by identifying the underlying belief system that generates specific mercantile policies, helping explain why such economically harmful practices persist. It illuminates the ideological mechanism connecting theory to practice in Smith's critique.

Evaluation: Mercantile System Principles

definition_precision — 4.0 / 5.0

The definition clearly identifies three specific doctrines (precious metals as wealth, zero-sum trade, colonial subordination) that form a coherent ideological framework. While "restrictive trade practices" could be more specific, the core principles are well-delineated and non-circular.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's extensive critique of mercantile doctrine throughout Book IV, where he systematically examines these exact principles and their policy implications. The definition accurately captures concepts that Smith explicitly discusses and refutes.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain since these principles constitute the theoretical foundation underlying specific mercantile policies rather than particular economic mechanisms or historical events. This represents the ideological superstructure that Smith seeks to dismantle.

vsm_relevance — 4.0 / 5.0

This entity maps well to S5 (identity/policy) as it represents the fundamental worldview and policy principles that guide mercantile decision-making. It also connects to S4 (intelligence) in terms of how mercantile thinkers interpret economic information through their doctrinal lens.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power by identifying the underlying belief system that generates specific mercantile policies, helping explain why such economically harmful practices persist. It illuminates the ideological mechanism connecting theory to practice in Smith's critique.

3.5 KiB Raw Blame History