Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

political_economy_objectives

null

2026-02-23T06:07:00.102900

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between mercantile objectives (precious metal accumulation) and Smith's preferred objectives (productive capacity, efficient allocation, general welfare). It avoids circularity and captures a specific conceptual distinction about competing approaches to political economy.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book IV, Chapter 1, where Smith explicitly contrasts the mercantile system's focus on favorable trade balances and precious metals with his vision of political economy centered on real production and general prosperity. The contrast between these competing objectives is central to Smith's critique.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the appropriate domain since political economy objectives fundamentally concern how governments should regulate and manage economic affairs. This entity captures the meta-level question of what regulatory goals should guide state economic policy.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps clearly to S5 (identity/policy) as it concerns the fundamental purposes and identity that should guide a nation's economic system. Political economy objectives define the overarching policy framework that determines how all other economic subsystems should operate.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory power by illuminating the structural difference between mercantile and Smithian approaches to economic policy. It helps explain why Smith advocates for different institutional arrangements and regulatory approaches based on fundamentally different conceptions of proper economic objectives.

Evaluation: Political Economy Objectives

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between mercantile objectives (precious metal accumulation) and Smith's preferred objectives (productive capacity, efficient allocation, general welfare). It avoids circularity and captures a specific conceptual distinction about competing approaches to political economy.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book IV, Chapter 1, where Smith explicitly contrasts the mercantile system's focus on favorable trade balances and precious metals with his vision of political economy centered on real production and general prosperity. The contrast between these competing objectives is central to Smith's critique.

domain_placement — 5.0 / 5.0

"Regulation" is the appropriate domain since political economy objectives fundamentally concern how governments should regulate and manage economic affairs. This entity captures the meta-level question of what regulatory goals should guide state economic policy.

vsm_relevance — 5.0 / 5.0

This entity maps clearly to S5 (identity/policy) as it concerns the fundamental purposes and identity that should guide a nation's economic system. Political economy objectives define the overarching policy framework that determines how all other economic subsystems should operate.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory power by illuminating the structural difference between mercantile and Smithian approaches to economic policy. It helps explain why Smith advocates for different institutional arrangements and regulatory approaches based on fundamentally different conceptions of proper economic objectives.

3.7 KiB Raw Blame History