feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: policy_closure_concept
evaluator: null
evaluated_at: '2026-02-23T06:06:34.307980'
overall_score: 2.8
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is vague and uses circular language ("clear objectives
and boundaries" without specifying what makes them clear or how boundaries are
determined). The concept of "policy closure" is not a standard economic term and
lacks the precision needed to distinguish it from general principles of limited
government.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does advocate for limited government intervention, he does
not articulate a specific "policy closure concept" as defined here. The entity
appears to impose modern terminology and framing onto Smith's more nuanced discussions
of appropriate government roles without direct textual support.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Regulation" domain assignment is appropriate given the focus on
government intervention limits. This concept naturally fits within discussions
of regulatory policy and the proper scope of government economic activity.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to VSM System 5 (identity/policy) as it concerns
fundamental policy boundaries and the identity constraints of government economic
intervention. It could also relate to S3 (internal regulation) regarding audit
and control mechanisms.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity provides limited explanatory power beyond restating the general
principle that government intervention should be limited. It doesn't illuminate
specific mechanisms or structural relations that would help understand how such
closure operates or why it matters economically.
---
# Evaluation: Policy Closure Concept
## definition_precision — 2.0 / 5.0
The definition is vague and uses circular language ("clear objectives and boundaries" without specifying what makes them clear or how boundaries are determined). The concept of "policy closure" is not a standard economic term and lacks the precision needed to distinguish it from general principles of limited government.
## source_grounding — 2.0 / 5.0
While Smith does advocate for limited government intervention, he does not articulate a specific "policy closure concept" as defined here. The entity appears to impose modern terminology and framing onto Smith's more nuanced discussions of appropriate government roles without direct textual support.
## domain_placement — 4.0 / 5.0
The "Regulation" domain assignment is appropriate given the focus on government intervention limits. This concept naturally fits within discussions of regulatory policy and the proper scope of government economic activity.
## vsm_relevance — 4.0 / 5.0
This entity maps well to VSM System 5 (identity/policy) as it concerns fundamental policy boundaries and the identity constraints of government economic intervention. It could also relate to S3 (internal regulation) regarding audit and control mechanisms.
## explanatory_value — 2.0 / 5.0
The entity provides limited explanatory power beyond restating the general principle that government intervention should be limited. It doesn't illuminate specific mechanisms or structural relations that would help understand how such closure operates or why it matters economically.