Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_policy

null

2026-02-23T05:19:43.335466

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept but is somewhat broad, encompassing "rules, regulations, and administrative measures" which could overlap with other entities. While it distinguishes policy from broader political economy, the boundaries between laws, institutions, and practices could be more precisely delineated.

name	value	max_value	rationale
source_grounding	2.0	5.0	The entity references Smith's discussion of political economy as "the science of the statesman or legislator" but extrapolates significantly beyond what Smith explicitly discusses. Smith focuses more on principles of political economy rather than detailed policy implementation mechanisms.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain is appropriate since this entity concerns the administrative and legal frameworks that govern economic activity. This clearly falls within regulatory rather than production, exchange, or distribution domains.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps very naturally to S5 (identity/policy) in the VSM, as it explicitly deals with policy formulation and the high-level rules that define how economic systems should operate. It represents the normative and strategic guidance function that S5 provides.

name	value	max_value	rationale
explanatory_value	2.0	5.0	While the entity names an important category, it doesn't illuminate specific mechanisms or structural relations that Smith analyzes. It remains at a high level of abstraction without revealing particular insights about how policy actually shapes economic outcomes in Smith's framework.

Evaluation: Economic System Policy

definition_precision — 3.0 / 5.0

The definition captures a coherent concept but is somewhat broad, encompassing "rules, regulations, and administrative measures" which could overlap with other entities. While it distinguishes policy from broader political economy, the boundaries between laws, institutions, and practices could be more precisely delineated.

source_grounding — 2.0 / 5.0

The entity references Smith's discussion of political economy as "the science of the statesman or legislator" but extrapolates significantly beyond what Smith explicitly discusses. Smith focuses more on principles of political economy rather than detailed policy implementation mechanisms.

domain_placement — 4.0 / 5.0

The "Regulation" domain is appropriate since this entity concerns the administrative and legal frameworks that govern economic activity. This clearly falls within regulatory rather than production, exchange, or distribution domains.

vsm_relevance — 5.0 / 5.0

This entity maps very naturally to S5 (identity/policy) in the VSM, as it explicitly deals with policy formulation and the high-level rules that define how economic systems should operate. It represents the normative and strategic guidance function that S5 provides.

explanatory_value — 2.0 / 5.0

While the entity names an important category, it doesn't illuminate specific mechanisms or structural relations that Smith analyzes. It remains at a high level of abstraction without revealing particular insights about how policy actually shapes economic outcomes in Smith's framework.

3.5 KiB Raw Blame History