Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_comprehension

null

2026-02-23T05:13:51.259572

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about economic understanding for governance, but uses somewhat circular language ("understanding...that enables" and "comprehension...necessary for"). The core idea is clear but could be more precisely articulated.

name	value	max_value	rationale
source_grounding	4.0	5.0	This aligns well with Smith's explicit positioning of political economy as a science for statesmen and legislators in Book IV. Smith does emphasize the need for economic understanding among those who govern, making this well-grounded in the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this represents Smith's meta-theoretical framework about political economy as a discipline. It's foundational to economic theory rather than belonging to a specific economic mechanism or policy area.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps naturally to S4 (intelligence/environmental adaptation) and S5 (identity/policy) systems, as it concerns the cognitive capabilities needed for strategic economic planning and policy formulation. It represents the intelligence function necessary for viable economic governance.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural requirement in Smith's framework - that effective economic governance depends on theoretical comprehension rather than mere intuition or tradition. It explains why Smith positions political economy as a science requiring systematic study.

Evaluation: Economic System Comprehension

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about economic understanding for governance, but uses somewhat circular language ("understanding...that enables" and "comprehension...necessary for"). The core idea is clear but could be more precisely articulated.

source_grounding — 4.0 / 5.0

This aligns well with Smith's explicit positioning of political economy as a science for statesmen and legislators in Book IV. Smith does emphasize the need for economic understanding among those who govern, making this well-grounded in the source text.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this represents Smith's meta-theoretical framework about political economy as a discipline. It's foundational to economic theory rather than belonging to a specific economic mechanism or policy area.

vsm_relevance — 4.0 / 5.0

This maps naturally to S4 (intelligence/environmental adaptation) and S5 (identity/policy) systems, as it concerns the cognitive capabilities needed for strategic economic planning and policy formulation. It represents the intelligence function necessary for viable economic governance.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural requirement in Smith's framework - that effective economic governance depends on theoretical comprehension rather than mere intuition or tradition. It explains why Smith positions political economy as a science requiring systematic study.

3.4 KiB Raw Blame History