feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: economic_system_transformation
evaluator: null
evaluated_at: '2026-02-23T05:21:36.958939'
overall_score: 3.4
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept of systemic economic change
but remains somewhat abstract and general. While it identifies key components
(institutions, policies, practices), it could be more precise about what constitutes
"fundamental" change versus incremental reform.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: The entity relies heavily on inference from Smith's "distinction between
ancient and modern systems" rather than explicit textual discussion of transformation
processes. Smith describes different systems but doesn't extensively theorize
about the mechanisms or nature of transitions between them.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate since this concept spans across Smith''s
analysis of different economic systems and represents a meta-level theoretical
construct. It''s not specific to any particular policy area or mechanism.'
- name: vsm_relevance
value: 5.0
max_value: 5.0
rationale: This entity maps excellently to S4 (intelligence/environmental adaptation)
as it represents how economic systems adapt to changing circumstances and environments.
It also connects to S5 (identity/policy) as transformations involve fundamental
changes in systemic identity and organizing principles.
- name: explanatory_value
value: 3.0
max_value: 5.0
rationale: While the concept helps organize thinking about systemic change in Smith's
work, it remains at a high level of abstraction without illuminating specific
mechanisms of transformation. It names an important phenomenon but doesn't deeply
explain how or why such transformations occur.
---
# Evaluation: Economic System Transformation
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept of systemic economic change but remains somewhat abstract and general. While it identifies key components (institutions, policies, practices), it could be more precise about what constitutes "fundamental" change versus incremental reform.
## source_grounding — 2.0 / 5.0
The entity relies heavily on inference from Smith's "distinction between ancient and modern systems" rather than explicit textual discussion of transformation processes. Smith describes different systems but doesn't extensively theorize about the mechanisms or nature of transitions between them.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate since this concept spans across Smith's analysis of different economic systems and represents a meta-level theoretical construct. It's not specific to any particular policy area or mechanism.
## vsm_relevance — 5.0 / 5.0
This entity maps excellently to S4 (intelligence/environmental adaptation) as it represents how economic systems adapt to changing circumstances and environments. It also connects to S5 (identity/policy) as transformations involve fundamental changes in systemic identity and organizing principles.
## explanatory_value — 3.0 / 5.0
While the concept helps organize thinking about systemic change in Smith's work, it remains at a high level of abstraction without illuminating specific mechanisms of transformation. It names an important phenomenon but doesn't deeply explain how or why such transformations occur.