Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

political_economy

null

2026-02-23T06:07:08.792206

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies political economy's dual objectives (providing subsistence for people and revenue for the state) and distinguishes it as a science for statesmen/legislators. While comprehensive, it could be slightly more concise in distinguishing political economy from pure economics.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit definition from the introduction to Book IV, where he specifically outlines these two objects of political economy. The definition closely follows Smith's own language and conceptual framework.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this represents Smith's foundational theoretical framework for the entire discipline of political economy. It establishes the overarching conceptual structure rather than addressing specific mechanisms.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Political economy maps well to S5 (identity/policy) as it defines the fundamental purpose and identity of economic governance, and partially to S4 (intelligence) as it involves systematic study of commercial systems. It represents the meta-level framework that guides all other economic subsystems.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by establishing the foundational framework that underlies Smith's entire analysis in The Wealth of Nations. It illuminates the dual nature of economic governance and provides the conceptual foundation for understanding subsequent mechanisms and policies.

Evaluation: Political Economy

definition_precision — 4.0 / 5.0

The definition clearly identifies political economy's dual objectives (providing subsistence for people and revenue for the state) and distinguishes it as a science for statesmen/legislators. While comprehensive, it could be slightly more concise in distinguishing political economy from pure economics.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit definition from the introduction to Book IV, where he specifically outlines these two objects of political economy. The definition closely follows Smith's own language and conceptual framework.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this represents Smith's foundational theoretical framework for the entire discipline of political economy. It establishes the overarching conceptual structure rather than addressing specific mechanisms.

vsm_relevance — 4.0 / 5.0

Political economy maps well to S5 (identity/policy) as it defines the fundamental purpose and identity of economic governance, and partially to S4 (intelligence) as it involves systematic study of commercial systems. It represents the meta-level framework that guides all other economic subsystems.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by establishing the foundational framework that underlies Smith's entire analysis in The Wealth of Nations. It illuminates the dual nature of economic governance and provides the conceptual foundation for understanding subsequent mechanisms and policies.

3.5 KiB Raw Blame History