feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: economic_system_sustainability
evaluator: null
evaluated_at: '2026-02-23T05:21:21.427046'
overall_score: 3.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept about long-term viability
of economic systems, but uses somewhat vague terms like "effectiveness" and "desired
outcomes" without specifying what these mean. The core idea of maintaining operations
without depleting foundational resources is reasonably precise.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: The entity acknowledges that sustainability is "not explicitly discussed
by Smith" and is only "implied" in his discussion of systems enriching people
and sovereigns. This represents a significant conceptual leap from what Smith
actually wrote, introducing modern sustainability frameworks onto 18th-century
economic theory.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate since this concept would span across
multiple economic domains rather than belonging to a specific area like trade
policy or taxation. The broad theoretical nature of sustainability as a systemic
property fits well in this domain.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to VSM System 5 (identity/policy) as it concerns
the fundamental viability and continuity of the entire economic system. It also
has relevance to S4 (environmental adaptation) regarding how systems maintain
themselves amid changing conditions.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: While sustainability is an important modern concept, this entity doesn't
illuminate specific mechanisms or structural relations that Smith described. It
functions more as a modern analytical overlay than as an explanation of how Smith's
economic systems actually operate.
---
# Evaluation: Economic System Sustainability
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept about long-term viability of economic systems, but uses somewhat vague terms like "effectiveness" and "desired outcomes" without specifying what these mean. The core idea of maintaining operations without depleting foundational resources is reasonably precise.
## source_grounding — 2.0 / 5.0
The entity acknowledges that sustainability is "not explicitly discussed by Smith" and is only "implied" in his discussion of systems enriching people and sovereigns. This represents a significant conceptual leap from what Smith actually wrote, introducing modern sustainability frameworks onto 18th-century economic theory.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate since this concept would span across multiple economic domains rather than belonging to a specific area like trade policy or taxation. The broad theoretical nature of sustainability as a systemic property fits well in this domain.
## vsm_relevance — 4.0 / 5.0
This entity maps well to VSM System 5 (identity/policy) as it concerns the fundamental viability and continuity of the entire economic system. It also has relevance to S4 (environmental adaptation) regarding how systems maintain themselves amid changing conditions.
## explanatory_value — 2.0 / 5.0
While sustainability is an important modern concept, this entity doesn't illuminate specific mechanisms or structural relations that Smith described. It functions more as a modern analytical overlay than as an explanation of how Smith's economic systems actually operate.