feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: economic_system_policy
evaluator: null
evaluated_at: '2026-02-23T05:19:43.335466'
overall_score: 3.2
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept but is somewhat broad, encompassing
"rules, regulations, and administrative measures" which could overlap with other
entities. While it distinguishes policy from broader political economy, the boundaries
between laws, institutions, and practices could be more precisely delineated.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: The entity references Smith's discussion of political economy as "the
science of the statesman or legislator" but extrapolates significantly beyond
what Smith explicitly discusses. Smith focuses more on principles of political
economy rather than detailed policy implementation mechanisms.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Regulation" domain is appropriate since this entity concerns the
administrative and legal frameworks that govern economic activity. This clearly
falls within regulatory rather than production, exchange, or distribution domains.
- name: vsm_relevance
value: 5.0
max_value: 5.0
rationale: This entity maps very naturally to S5 (identity/policy) in the VSM, as
it explicitly deals with policy formulation and the high-level rules that define
how economic systems should operate. It represents the normative and strategic
guidance function that S5 provides.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: While the entity names an important category, it doesn't illuminate specific
mechanisms or structural relations that Smith analyzes. It remains at a high level
of abstraction without revealing particular insights about how policy actually
shapes economic outcomes in Smith's framework.
---
# Evaluation: Economic System Policy
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept but is somewhat broad, encompassing "rules, regulations, and administrative measures" which could overlap with other entities. While it distinguishes policy from broader political economy, the boundaries between laws, institutions, and practices could be more precisely delineated.
## source_grounding — 2.0 / 5.0
The entity references Smith's discussion of political economy as "the science of the statesman or legislator" but extrapolates significantly beyond what Smith explicitly discusses. Smith focuses more on principles of political economy rather than detailed policy implementation mechanisms.
## domain_placement — 4.0 / 5.0
The "Regulation" domain is appropriate since this entity concerns the administrative and legal frameworks that govern economic activity. This clearly falls within regulatory rather than production, exchange, or distribution domains.
## vsm_relevance — 5.0 / 5.0
This entity maps very naturally to S5 (identity/policy) in the VSM, as it explicitly deals with policy formulation and the high-level rules that define how economic systems should operate. It represents the normative and strategic guidance function that S5 provides.
## explanatory_value — 2.0 / 5.0
While the entity names an important category, it doesn't illuminate specific mechanisms or structural relations that Smith analyzes. It remains at a high level of abstraction without revealing particular insights about how policy actually shapes economic outcomes in Smith's framework.