Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

policy_closure_concept

null

2026-02-23T06:06:34.307980

2.8

name	value	max_value	rationale
definition_precision	2.0	5.0	The definition is vague and uses circular language ("clear objectives and boundaries" without specifying what makes them clear or how boundaries are determined). The concept of "policy closure" is not a standard economic term and lacks the precision needed to distinguish it from general principles of limited government.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does advocate for limited government intervention, he does not articulate a specific "policy closure concept" as defined here. The entity appears to impose modern terminology and framing onto Smith's more nuanced discussions of appropriate government roles without direct textual support.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain assignment is appropriate given the focus on government intervention limits. This concept naturally fits within discussions of regulatory policy and the proper scope of government economic activity.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 5 (identity/policy) as it concerns fundamental policy boundaries and the identity constraints of government economic intervention. It could also relate to S3 (internal regulation) regarding audit and control mechanisms.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity provides limited explanatory power beyond restating the general principle that government intervention should be limited. It doesn't illuminate specific mechanisms or structural relations that would help understand how such closure operates or why it matters economically.

Evaluation: Policy Closure Concept

definition_precision — 2.0 / 5.0

The definition is vague and uses circular language ("clear objectives and boundaries" without specifying what makes them clear or how boundaries are determined). The concept of "policy closure" is not a standard economic term and lacks the precision needed to distinguish it from general principles of limited government.

source_grounding — 2.0 / 5.0

While Smith does advocate for limited government intervention, he does not articulate a specific "policy closure concept" as defined here. The entity appears to impose modern terminology and framing onto Smith's more nuanced discussions of appropriate government roles without direct textual support.

domain_placement — 4.0 / 5.0

The "Regulation" domain assignment is appropriate given the focus on government intervention limits. This concept naturally fits within discussions of regulatory policy and the proper scope of government economic activity.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 5 (identity/policy) as it concerns fundamental policy boundaries and the identity constraints of government economic intervention. It could also relate to S3 (internal regulation) regarding audit and control mechanisms.

explanatory_value — 2.0 / 5.0

The entity provides limited explanatory power beyond restating the general principle that government intervention should be limited. It doesn't illuminate specific mechanisms or structural relations that would help understand how such closure operates or why it matters economically.

3.4 KiB Raw Blame History