feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: commercial_family_duration_pattern
evaluator: null
evaluated_at: '2026-02-23T04:58:00.302118'
overall_score: 3.8
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific empirical observation about
wealth persistence patterns across different economic systems. It precisely contrasts
commercial vs. agricultural societies and identifies the causal mechanism (extravagant
spending vs. property consumability).
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity directly reflects Smith's explicit observations in Book III,
Chapter 4 about the rarity of old wealthy families in commercial countries versus
their prevalence in non-commercial societies. The explanation about vanity, personal
expense, and consumable property is faithful to Smith's analysis.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is appropriate as this represents a broad sociological
observation about commerce''s effects on social structures rather than a specific
economic mechanism. It bridges economic activity and social outcomes in Smith''s
theoretical framework.'
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity describes a long-term social pattern rather than an operational
system component, making it difficult to map to any specific VSM system. It's
more of a systemic outcome or emergent property than a functional element of economic
organization.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important structural relationship between commercial
development and social stratification patterns, explaining how different economic
systems affect wealth concentration and family continuity. It reveals a non-obvious
consequence of commercial society that connects economic and social dynamics.
---
# Evaluation: Commercial Family Duration Pattern
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific empirical observation about wealth persistence patterns across different economic systems. It precisely contrasts commercial vs. agricultural societies and identifies the causal mechanism (extravagant spending vs. property consumability).
## source_grounding — 5.0 / 5.0
This entity directly reflects Smith's explicit observations in Book III, Chapter 4 about the rarity of old wealthy families in commercial countries versus their prevalence in non-commercial societies. The explanation about vanity, personal expense, and consumable property is faithful to Smith's analysis.
## domain_placement — 4.0 / 5.0
"General Theory" is appropriate as this represents a broad sociological observation about commerce's effects on social structures rather than a specific economic mechanism. It bridges economic activity and social outcomes in Smith's theoretical framework.
## vsm_relevance — 2.0 / 5.0
This entity describes a long-term social pattern rather than an operational system component, making it difficult to map to any specific VSM system. It's more of a systemic outcome or emergent property than a functional element of economic organization.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important structural relationship between commercial development and social stratification patterns, explaining how different economic systems affect wealth concentration and family continuity. It reveals a non-obvious consequence of commercial society that connects economic and social dynamics.