Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_maxims_inversion

null

2026-02-23T04:58:45.700501

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures a specific phenomenon - the inversion of sound economic principles that leads nations to view others' prosperity as threatening rather than beneficial. It's precise in describing both the mindset and its policy consequences, though "perverse economic principles" could be slightly more specific.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's critique of mercantile theory throughout Book IV, where he repeatedly argues that mercantilism teaches nations to view trade as zero-sum and to pursue policies that harm neighbors. The "inversion" language accurately captures Smith's argument that mercantilism turns natural economic reasoning upside down.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain since this represents a fundamental theoretical critique of mercantile thinking that underlies Smith's broader argument about trade policy. It's a meta-level concept about how economic reasoning itself can be corrupted.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S4 (intelligence/environmental adaptation) as it describes how nations misinterpret their economic environment and relationships with other nations. It could also relate to S5 (identity/policy) in terms of how nations define their interests, making it quite relevant to VSM analysis.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by identifying the underlying logical error that drives mercantile policy - the fundamental misunderstanding of trade as zero-sum rather than positive-sum. It illuminates why nations consistently adopt self-defeating trade policies despite evidence of their failure.

Evaluation: Commercial Maxims Inversion

definition_precision — 4.0 / 5.0

The definition clearly captures a specific phenomenon - the inversion of sound economic principles that leads nations to view others' prosperity as threatening rather than beneficial. It's precise in describing both the mindset and its policy consequences, though "perverse economic principles" could be slightly more specific.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's critique of mercantile theory throughout Book IV, where he repeatedly argues that mercantilism teaches nations to view trade as zero-sum and to pursue policies that harm neighbors. The "inversion" language accurately captures Smith's argument that mercantilism turns natural economic reasoning upside down.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain since this represents a fundamental theoretical critique of mercantile thinking that underlies Smith's broader argument about trade policy. It's a meta-level concept about how economic reasoning itself can be corrupted.

vsm_relevance — 4.0 / 5.0

This maps well to S4 (intelligence/environmental adaptation) as it describes how nations misinterpret their economic environment and relationships with other nations. It could also relate to S5 (identity/policy) in terms of how nations define their interests, making it quite relevant to VSM analysis.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by identifying the underlying logical error that drives mercantile policy - the fundamental misunderstanding of trade as zero-sum rather than positive-sum. It illuminates why nations consistently adopt self-defeating trade policies despite evidence of their failure.

3.8 KiB Raw Blame History