feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: economic_system_integration
evaluator: null
evaluated_at: '2026-02-23T05:17:40.809238'
overall_score: 2.6
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is overly broad and vague, using generic terms like "coordination,"
"harmonization," and "unified economic objectives" without specifying what constitutes
integration or how it differs from general economic coordination. It reads more
like a modern management concept than a precise economic principle.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss political economy as a science, the entity extrapolates
far beyond what Smith actually argues, imposing modern systems thinking language
("integration," "alignment of institutions") that doesn't reflect his 18th-century
analytical framework. The connection to "Book IV, Chapter 0" is also questionable
as this appears to be a general introduction rather than substantive content.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: '"General Theory" is appropriate given the broad, abstract nature of
the concept, though the entity might better fit under "Policy" or "Institutional"
domains if it were more precisely defined. The current placement reflects its
vague, overarching character.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S2 (coordination) and potentially S3 (internal
regulation) in the VSM framework, as it explicitly deals with coordination and
harmonization of system components. The integration focus aligns naturally with
VSM's emphasis on system coherence and coordination mechanisms.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity provides little explanatory power beyond naming a general
phenomenon, offering no insight into specific mechanisms, trade-offs, or structural
relationships that Smith identifies. It functions more as a conceptual umbrella
than as an analytical tool that illuminates economic processes.
---
# Evaluation: Economic System Integration
## definition_precision — 2.0 / 5.0
The definition is overly broad and vague, using generic terms like "coordination," "harmonization," and "unified economic objectives" without specifying what constitutes integration or how it differs from general economic coordination. It reads more like a modern management concept than a precise economic principle.
## source_grounding — 2.0 / 5.0
While Smith does discuss political economy as a science, the entity extrapolates far beyond what Smith actually argues, imposing modern systems thinking language ("integration," "alignment of institutions") that doesn't reflect his 18th-century analytical framework. The connection to "Book IV, Chapter 0" is also questionable as this appears to be a general introduction rather than substantive content.
## domain_placement — 3.0 / 5.0
"General Theory" is appropriate given the broad, abstract nature of the concept, though the entity might better fit under "Policy" or "Institutional" domains if it were more precisely defined. The current placement reflects its vague, overarching character.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S2 (coordination) and potentially S3 (internal regulation) in the VSM framework, as it explicitly deals with coordination and harmonization of system components. The integration focus aligns naturally with VSM's emphasis on system coherence and coordination mechanisms.
## explanatory_value — 2.0 / 5.0
The entity provides little explanatory power beyond naming a general phenomenon, offering no insight into specific mechanisms, trade-offs, or structural relationships that Smith identifies. It functions more as a conceptual umbrella than as an analytical tool that illuminates economic processes.