feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: economic_system_innovation
evaluator: null
evaluated_at: '2026-02-23T05:17:21.877707'
overall_score: 2.6
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is overly broad and vague, essentially describing any
change or improvement in economic systems without clear boundaries. It reads more
like a general description of economic progress than a precise concept that can
be operationalized or distinguished from related phenomena.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: The entity claims to derive from "Book IV, Chapter 0" (which doesn't
exist - Book IV has no Chapter 0) and relies on vague references to Smith's "discussion
of modern systems and their advantages." This appears to extrapolate far beyond
what Smith actually discusses, imposing modern innovation terminology on 18th-century
economic analysis.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: '"General Theory" is appropriate given the broad, abstract nature of
the concept, though the concept itself may be too diffuse to warrant its own entity.
The domain placement correctly reflects that this doesn''t fit neatly into more
specific economic categories like trade, production, or policy.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This concept maps well to S4 (intelligence/environmental adaptation)
as it describes how economic systems develop new approaches to adapt to changing
conditions. The innovation aspect directly relates to the intelligence function's
role in environmental scanning and system evolution.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity provides little explanatory power beyond naming a general
phenomenon of economic change. It doesn't illuminate specific mechanisms, causal
relationships, or structural features that would help understand how economic
systems actually function or evolve.
---
# Evaluation: Economic System Innovation
## definition_precision — 2.0 / 5.0
The definition is overly broad and vague, essentially describing any change or improvement in economic systems without clear boundaries. It reads more like a general description of economic progress than a precise concept that can be operationalized or distinguished from related phenomena.
## source_grounding — 2.0 / 5.0
The entity claims to derive from "Book IV, Chapter 0" (which doesn't exist - Book IV has no Chapter 0) and relies on vague references to Smith's "discussion of modern systems and their advantages." This appears to extrapolate far beyond what Smith actually discusses, imposing modern innovation terminology on 18th-century economic analysis.
## domain_placement — 3.0 / 5.0
"General Theory" is appropriate given the broad, abstract nature of the concept, though the concept itself may be too diffuse to warrant its own entity. The domain placement correctly reflects that this doesn't fit neatly into more specific economic categories like trade, production, or policy.
## vsm_relevance — 4.0 / 5.0
This concept maps well to S4 (intelligence/environmental adaptation) as it describes how economic systems develop new approaches to adapt to changing conditions. The innovation aspect directly relates to the intelligence function's role in environmental scanning and system evolution.
## explanatory_value — 2.0 / 5.0
The entity provides little explanatory power beyond naming a general phenomenon of economic change. It doesn't illuminate specific mechanisms, causal relationships, or structural features that would help understand how economic systems actually function or evolve.