feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,62 @@
---
entity_slug: economic_system_objectives
evaluator: null
evaluated_at: '2026-02-23T05:18:57.651696'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies two specific objectives (providing
subsistence for people and generating revenue for public services) rather than
using vague language. It's precise and non-circular, though it could be slightly
more detailed about how these objectives relate to each other.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's explicit identification of
political economy's dual objectives in Book IV. The definition accurately reflects
Smith's own framework without introducing external concepts or interpretations.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement since this represents
Smith''s foundational theoretical framework for understanding the purposes of
economic systems. It''s a meta-level concept that underpins his entire analytical
approach.'
- name: vsm_relevance
value: 5.0
max_value: 5.0
rationale: This entity maps clearly to VSM System 5 (identity/policy) as it defines
the fundamental purposes and identity of the economic system. These objectives
serve as the policy framework that guides all other system functions and operations.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides significant explanatory value by establishing the
foundational purposes against which economic arrangements can be evaluated and
understood. It illuminates the structural logic of Smith's entire analytical framework,
though it's more of a foundational principle than a specific mechanism.
---
# Evaluation: Economic System Objectives
## definition_precision — 4.0 / 5.0
The definition clearly identifies two specific objectives (providing subsistence for people and generating revenue for public services) rather than using vague language. It's precise and non-circular, though it could be slightly more detailed about how these objectives relate to each other.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's explicit identification of political economy's dual objectives in Book IV. The definition accurately reflects Smith's own framework without introducing external concepts or interpretations.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement since this represents Smith's foundational theoretical framework for understanding the purposes of economic systems. It's a meta-level concept that underpins his entire analytical approach.
## vsm_relevance — 5.0 / 5.0
This entity maps clearly to VSM System 5 (identity/policy) as it defines the fundamental purposes and identity of the economic system. These objectives serve as the policy framework that guides all other system functions and operations.
## explanatory_value — 4.0 / 5.0
The entity provides significant explanatory value by establishing the foundational purposes against which economic arrangements can be evaluated and understood. It illuminates the structural logic of Smith's entire analytical framework, though it's more of a foundational principle than a specific mechanism.