Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_objectives

null

2026-02-23T05:18:57.651696

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies two specific objectives (providing subsistence for people and generating revenue for public services) rather than using vague language. It's precise and non-circular, though it could be slightly more detailed about how these objectives relate to each other.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit identification of political economy's dual objectives in Book IV. The definition accurately reflects Smith's own framework without introducing external concepts or interpretations.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this represents Smith's foundational theoretical framework for understanding the purposes of economic systems. It's a meta-level concept that underpins his entire analytical approach.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps clearly to VSM System 5 (identity/policy) as it defines the fundamental purposes and identity of the economic system. These objectives serve as the policy framework that guides all other system functions and operations.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory value by establishing the foundational purposes against which economic arrangements can be evaluated and understood. It illuminates the structural logic of Smith's entire analytical framework, though it's more of a foundational principle than a specific mechanism.

Evaluation: Economic System Objectives

definition_precision — 4.0 / 5.0

The definition clearly identifies two specific objectives (providing subsistence for people and generating revenue for public services) rather than using vague language. It's precise and non-circular, though it could be slightly more detailed about how these objectives relate to each other.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit identification of political economy's dual objectives in Book IV. The definition accurately reflects Smith's own framework without introducing external concepts or interpretations.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this represents Smith's foundational theoretical framework for understanding the purposes of economic systems. It's a meta-level concept that underpins his entire analytical approach.

vsm_relevance — 5.0 / 5.0

This entity maps clearly to VSM System 5 (identity/policy) as it defines the fundamental purposes and identity of the economic system. These objectives serve as the policy framework that guides all other system functions and operations.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory value by establishing the foundational purposes against which economic arrangements can be evaluated and understood. It illuminates the structural logic of Smith's entire analytical framework, though it's more of a foundational principle than a specific mechanism.

3.3 KiB Raw Blame History