feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: country_life_charms
evaluator: null
evaluated_at: '2026-02-23T05:04:10.194404'
overall_score: 3.8
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies specific non-economic attractions (beauty,
pleasure, tranquility, independence) that distinguish country life charms from
purely economic motivations. While somewhat descriptive, it captures a distinct
concept about the qualitative appeal of rural life.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual discussion in Book III,
Chapter 1, where he explicitly describes the "charms of country life" and their
role in maintaining agricultural preferences. The concept directly reflects Smith's
own language and reasoning about non-economic factors in agricultural investment.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate since this concept explains broader
patterns of human economic behavior beyond specific agricultural mechanics. It
represents a theoretical insight about how non-economic factors influence economic
choices across different stages of development.'
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity is largely VSM-neutral as it describes cultural/psychological
preferences rather than operational or regulatory mechanisms. While it might loosely
relate to S4 (environmental factors influencing system adaptation), it doesn't
map naturally to any specific VSM system function.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by identifying non-economic
factors that help explain persistent agricultural preferences despite economic
incentives favoring other sectors. It illuminates an important mechanism in Smith's
theory of how human motivations beyond profit shape economic development patterns.
---
# Evaluation: Country Life Charms
## definition_precision — 4.0 / 5.0
The definition clearly identifies specific non-economic attractions (beauty, pleasure, tranquility, independence) that distinguish country life charms from purely economic motivations. While somewhat descriptive, it captures a distinct concept about the qualitative appeal of rural life.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual discussion in Book III, Chapter 1, where he explicitly describes the "charms of country life" and their role in maintaining agricultural preferences. The concept directly reflects Smith's own language and reasoning about non-economic factors in agricultural investment.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate since this concept explains broader patterns of human economic behavior beyond specific agricultural mechanics. It represents a theoretical insight about how non-economic factors influence economic choices across different stages of development.
## vsm_relevance — 2.0 / 5.0
This entity is largely VSM-neutral as it describes cultural/psychological preferences rather than operational or regulatory mechanisms. While it might loosely relate to S4 (environmental factors influencing system adaptation), it doesn't map naturally to any specific VSM system function.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by identifying non-economic factors that help explain persistent agricultural preferences despite economic incentives favoring other sectors. It illuminates an important mechanism in Smith's theory of how human motivations beyond profit shape economic development patterns.