feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: economic_system_innovation_driver
evaluator: null
evaluated_at: '2026-02-23T05:17:13.555032'
overall_score: 2.6
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is overly broad and umbrella-like, encompassing "factors
and forces" without clear boundaries between technological change, understanding,
circumstances, and pursuit of outcomes. It lacks precision in distinguishing this
concept from general causation or change processes in economics.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: The entity claims to derive from "Book IV, Chapter 0" which doesn't exist
(Book IV has 9 chapters), and the context description vaguely references Smith's
"discussion of modern systems" without specific textual grounding. This appears
to extrapolate beyond what Smith actually discusses about innovation drivers.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: '"General Theory" is appropriate given the broad conceptual nature, but
the entity is so abstract it could fit multiple domains. The placement is reasonable
but not particularly illuminating given the entity''s vague scope.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it describes forces that drive system evolution and adaptation to changing circumstances.
The concept of innovation drivers naturally fits the VSM's emphasis on environmental
scanning and adaptive response.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity provides minimal explanatory power, functioning more as a
label for various change processes rather than illuminating specific mechanisms
or structural relations. It doesn't clarify how these drivers actually work or
interact within Smith's economic framework.
---
# Evaluation: Economic System Innovation Driver
## definition_precision — 2.0 / 5.0
The definition is overly broad and umbrella-like, encompassing "factors and forces" without clear boundaries between technological change, understanding, circumstances, and pursuit of outcomes. It lacks precision in distinguishing this concept from general causation or change processes in economics.
## source_grounding — 2.0 / 5.0
The entity claims to derive from "Book IV, Chapter 0" which doesn't exist (Book IV has 9 chapters), and the context description vaguely references Smith's "discussion of modern systems" without specific textual grounding. This appears to extrapolate beyond what Smith actually discusses about innovation drivers.
## domain_placement — 3.0 / 5.0
"General Theory" is appropriate given the broad conceptual nature, but the entity is so abstract it could fit multiple domains. The placement is reasonable but not particularly illuminating given the entity's vague scope.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it describes forces that drive system evolution and adaptation to changing circumstances. The concept of innovation drivers naturally fits the VSM's emphasis on environmental scanning and adaptive response.
## explanatory_value — 2.0 / 5.0
The entity provides minimal explanatory power, functioning more as a label for various change processes rather than illuminating specific mechanisms or structural relations. It doesn't clarify how these drivers actually work or interact within Smith's economic framework.