feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,64 @@
|
||||
---
|
||||
entity_slug: subsistence_industry_priority
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T06:26:54.410735'
|
||||
overall_score: 4.6
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly articulates a specific economic principle about
|
||||
the temporal and logical sequence of industry development, distinguishing between
|
||||
necessities, conveniences, and luxuries. It avoids circularity and captures a
|
||||
distinct developmental concept with clear causal implications.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is directly grounded in Book III, Chapter 1 of The Wealth
|
||||
of Nations, where Smith explicitly discusses the natural order of economic development
|
||||
and the priority of agriculture over manufacturing. The entity accurately reflects
|
||||
Smith's argument about the foundational role of subsistence production.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The "Production" domain assignment is entirely appropriate, as this principle
|
||||
fundamentally concerns the organization and sequencing of productive activities.
|
||||
The concept directly addresses how different types of production relate to each
|
||||
other in economic development.
|
||||
- name: vsm_relevance
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity maps well to S1 (primary operations) as it defines the foundational
|
||||
productive activities that must exist first, and to S4 (intelligence/adaptation)
|
||||
as it represents a strategic principle for understanding environmental constraints
|
||||
on development. The temporal sequencing aspect gives it clear VSM relevance.
|
||||
- name: explanatory_value
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides significant explanatory power by illuminating the
|
||||
structural mechanism underlying economic development sequences and explaining
|
||||
why certain development paths succeed while others fail. It reveals the logical
|
||||
foundation for Smith's broader arguments about natural economic progression.
|
||||
---
|
||||
|
||||
# Evaluation: Subsistence Industry Priority
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly articulates a specific economic principle about the temporal and logical sequence of industry development, distinguishing between necessities, conveniences, and luxuries. It avoids circularity and captures a distinct developmental concept with clear causal implications.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This concept is directly grounded in Book III, Chapter 1 of The Wealth of Nations, where Smith explicitly discusses the natural order of economic development and the priority of agriculture over manufacturing. The entity accurately reflects Smith's argument about the foundational role of subsistence production.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
The "Production" domain assignment is entirely appropriate, as this principle fundamentally concerns the organization and sequencing of productive activities. The concept directly addresses how different types of production relate to each other in economic development.
|
||||
|
||||
## vsm_relevance — 4.0 / 5.0
|
||||
|
||||
This entity maps well to S1 (primary operations) as it defines the foundational productive activities that must exist first, and to S4 (intelligence/adaptation) as it represents a strategic principle for understanding environmental constraints on development. The temporal sequencing aspect gives it clear VSM relevance.
|
||||
|
||||
## explanatory_value — 5.0 / 5.0
|
||||
|
||||
This entity provides significant explanatory power by illuminating the structural mechanism underlying economic development sequences and explaining why certain development paths succeed while others fail. It reveals the logical foundation for Smith's broader arguments about natural economic progression.
|
||||
Reference in New Issue
Block a user