feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: economic_system_context
evaluator: null
evaluated_at: '2026-02-23T05:14:09.117271'
overall_score: 3.8
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a meaningful concept about contextual factors
shaping economic systems, but it's somewhat broad and could benefit from more
precise boundaries. The phrase "circumstances that shape" is clear but the enumeration
of factors (stage of opulence, technology, culture) feels somewhat open-ended
rather than definitively bounded.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's explicit recognition that different
ages and nations produce different economic systems, which is a clear theme throughout
Book IV. The concept directly reflects Smith's comparative approach to analyzing
mercantile versus other systems across different historical and geographical contexts.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is an appropriate domain placement since this concept
operates at a meta-level about how economic systems emerge and function across
different contexts. It''s foundational to understanding Smith''s broader theoretical
framework rather than being specific to particular economic mechanisms.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps naturally to S4 (intelligence/environmental adaptation)
as it concerns how economic systems must adapt to and reflect their environmental
context. It also has relevance to S5 (identity/policy) in terms of how contextual
factors shape the fundamental character and policy orientation of economic arrangements.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides genuine explanatory power by illuminating why different
economic systems emerge in different contexts rather than treating economic arrangements
as universal. It helps explain the structural relationship between environmental
conditions and institutional forms, which is central to Smith's analytical method.
---
# Evaluation: Economic System Context
## definition_precision — 3.0 / 5.0
The definition captures a meaningful concept about contextual factors shaping economic systems, but it's somewhat broad and could benefit from more precise boundaries. The phrase "circumstances that shape" is clear but the enumeration of factors (stage of opulence, technology, culture) feels somewhat open-ended rather than definitively bounded.
## source_grounding — 4.0 / 5.0
This entity is well-grounded in Smith's explicit recognition that different ages and nations produce different economic systems, which is a clear theme throughout Book IV. The concept directly reflects Smith's comparative approach to analyzing mercantile versus other systems across different historical and geographical contexts.
## domain_placement — 4.0 / 5.0
"General Theory" is an appropriate domain placement since this concept operates at a meta-level about how economic systems emerge and function across different contexts. It's foundational to understanding Smith's broader theoretical framework rather than being specific to particular economic mechanisms.
## vsm_relevance — 4.0 / 5.0
This entity maps naturally to S4 (intelligence/environmental adaptation) as it concerns how economic systems must adapt to and reflect their environmental context. It also has relevance to S5 (identity/policy) in terms of how contextual factors shape the fundamental character and policy orientation of economic arrangements.
## explanatory_value — 4.0 / 5.0
This entity provides genuine explanatory power by illuminating why different economic systems emerge in different contexts rather than treating economic arrangements as universal. It helps explain the structural relationship between environmental conditions and institutional forms, which is central to Smith's analytical method.