feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: economic_opportunity_cost
evaluator: null
evaluated_at: '2026-02-23T05:11:13.704041'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures the specific concept of foregone benefits
from limited market access and specialization constraints. While it could be slightly
more precise about the causal mechanism, it avoids circularity and distinguishes
this from general opportunity cost by focusing on market extent limitations.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
3, with specific examples cited (the highland nailer, farmers as butchers/bakers/brewers).
The concept emerges naturally from Smith's discussion of how market size constraints
force suboptimal resource allocation.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this concept
represents a fundamental theoretical principle about market functioning and specialization
constraints. It''s not sector-specific but rather a core mechanism in Smith''s
economic framework.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily relating to S4 (intelligence/adaptation)
as it concerns environmental constraints limiting system optimization, and S1
(operations) regarding production efficiency. However, it's somewhat abstract
and doesn't map cleanly to a single VSM system.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating the
structural relationship between market extent and economic efficiency. It reveals
a key mechanism in Smith's theory about how geographic and institutional constraints
create systematic inefficiencies through forced self-sufficiency.
---
# Evaluation: Economic Opportunity Cost
## definition_precision — 4.0 / 5.0
The definition clearly captures the specific concept of foregone benefits from limited market access and specialization constraints. While it could be slightly more precise about the causal mechanism, it avoids circularity and distinguishes this from general opportunity cost by focusing on market extent limitations.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book I, Chapter 3, with specific examples cited (the highland nailer, farmers as butchers/bakers/brewers). The concept emerges naturally from Smith's discussion of how market size constraints force suboptimal resource allocation.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical principle about market functioning and specialization constraints. It's not sector-specific but rather a core mechanism in Smith's economic framework.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily relating to S4 (intelligence/adaptation) as it concerns environmental constraints limiting system optimization, and S1 (operations) regarding production efficiency. However, it's somewhat abstract and doesn't map cleanly to a single VSM system.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating the structural relationship between market extent and economic efficiency. It reveals a key mechanism in Smith's theory about how geographic and institutional constraints create systematic inefficiencies through forced self-sufficiency.