feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: subsistence_industry_priority
evaluator: null
evaluated_at: '2026-02-23T06:26:54.410735'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly articulates a specific economic principle about
the temporal and logical sequence of industry development, distinguishing between
necessities, conveniences, and luxuries. It avoids circularity and captures a
distinct developmental concept with clear causal implications.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Book III, Chapter 1 of The Wealth
of Nations, where Smith explicitly discusses the natural order of economic development
and the priority of agriculture over manufacturing. The entity accurately reflects
Smith's argument about the foundational role of subsistence production.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Production" domain assignment is entirely appropriate, as this principle
fundamentally concerns the organization and sequencing of productive activities.
The concept directly addresses how different types of production relate to each
other in economic development.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S1 (primary operations) as it defines the foundational
productive activities that must exist first, and to S4 (intelligence/adaptation)
as it represents a strategic principle for understanding environmental constraints
on development. The temporal sequencing aspect gives it clear VSM relevance.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating the
structural mechanism underlying economic development sequences and explaining
why certain development paths succeed while others fail. It reveals the logical
foundation for Smith's broader arguments about natural economic progression.
---
# Evaluation: Subsistence Industry Priority
## definition_precision — 4.0 / 5.0
The definition clearly articulates a specific economic principle about the temporal and logical sequence of industry development, distinguishing between necessities, conveniences, and luxuries. It avoids circularity and captures a distinct developmental concept with clear causal implications.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Book III, Chapter 1 of The Wealth of Nations, where Smith explicitly discusses the natural order of economic development and the priority of agriculture over manufacturing. The entity accurately reflects Smith's argument about the foundational role of subsistence production.
## domain_placement — 5.0 / 5.0
The "Production" domain assignment is entirely appropriate, as this principle fundamentally concerns the organization and sequencing of productive activities. The concept directly addresses how different types of production relate to each other in economic development.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S1 (primary operations) as it defines the foundational productive activities that must exist first, and to S4 (intelligence/adaptation) as it represents a strategic principle for understanding environmental constraints on development. The temporal sequencing aspect gives it clear VSM relevance.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating the structural mechanism underlying economic development sequences and explaining why certain development paths succeed while others fail. It reveals the logical foundation for Smith's broader arguments about natural economic progression.