feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,64 @@
|
||||
---
|
||||
entity_slug: economic_system_adaptation
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T05:12:31.645449'
|
||||
overall_score: 3.4
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: The definition captures a coherent concept about economic systems evolving
|
||||
over time, but it's somewhat broad and could apply to many different types of
|
||||
change. The phrase "changing circumstances" is vague and the definition doesn't
|
||||
clearly distinguish this from general economic evolution or policy adjustment.
|
||||
- name: source_grounding
|
||||
value: 2.0
|
||||
max_value: 5.0
|
||||
rationale: While Smith does discuss different economic systems and their historical
|
||||
context, the specific concept of "adaptation" as a dynamic process is largely
|
||||
inferred rather than explicitly articulated by Smith. The entity extrapolates
|
||||
beyond what Smith directly states about economic systems responding to circumstances.
|
||||
- name: domain_placement
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: '"General Theory" is appropriate since this concept spans across different
|
||||
economic domains and represents a meta-principle about how economic systems function.
|
||||
It''s correctly placed as a broad theoretical concept rather than in a specific
|
||||
economic sector.'
|
||||
- name: vsm_relevance
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps very naturally to S4 (intelligence/environmental adaptation)
|
||||
in the VSM, as it directly concerns how economic systems sense environmental changes
|
||||
and adapt accordingly. It represents exactly the kind of adaptive intelligence
|
||||
function that S4 embodies.
|
||||
- name: explanatory_value
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: The concept provides some explanatory value by highlighting the adaptive
|
||||
nature of economic systems, but it remains at a high level of abstraction. It
|
||||
names an important phenomenon but doesn't deeply illuminate the specific mechanisms
|
||||
by which adaptation occurs or the structural relations involved.
|
||||
---
|
||||
|
||||
# Evaluation: Economic System Adaptation
|
||||
|
||||
## definition_precision — 3.0 / 5.0
|
||||
|
||||
The definition captures a coherent concept about economic systems evolving over time, but it's somewhat broad and could apply to many different types of change. The phrase "changing circumstances" is vague and the definition doesn't clearly distinguish this from general economic evolution or policy adjustment.
|
||||
|
||||
## source_grounding — 2.0 / 5.0
|
||||
|
||||
While Smith does discuss different economic systems and their historical context, the specific concept of "adaptation" as a dynamic process is largely inferred rather than explicitly articulated by Smith. The entity extrapolates beyond what Smith directly states about economic systems responding to circumstances.
|
||||
|
||||
## domain_placement — 4.0 / 5.0
|
||||
|
||||
"General Theory" is appropriate since this concept spans across different economic domains and represents a meta-principle about how economic systems function. It's correctly placed as a broad theoretical concept rather than in a specific economic sector.
|
||||
|
||||
## vsm_relevance — 5.0 / 5.0
|
||||
|
||||
This entity maps very naturally to S4 (intelligence/environmental adaptation) in the VSM, as it directly concerns how economic systems sense environmental changes and adapt accordingly. It represents exactly the kind of adaptive intelligence function that S4 embodies.
|
||||
|
||||
## explanatory_value — 3.0 / 5.0
|
||||
|
||||
The concept provides some explanatory value by highlighting the adaptive nature of economic systems, but it remains at a high level of abstraction. It names an important phenomenon but doesn't deeply illuminate the specific mechanisms by which adaptation occurs or the structural relations involved.
|
||||
Reference in New Issue
Block a user