Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_family_duration_pattern

null

2026-02-23T04:58:00.302118

3.8

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures a specific empirical observation about wealth persistence patterns across different economic systems. It precisely contrasts commercial vs. agricultural societies and identifies the causal mechanism (extravagant spending vs. property consumability).

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's explicit observations in Book III, Chapter 4 about the rarity of old wealthy families in commercial countries versus their prevalence in non-commercial societies. The explanation about vanity, personal expense, and consumable property is faithful to Smith's analysis.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as this represents a broad sociological observation about commerce's effects on social structures rather than a specific economic mechanism. It bridges economic activity and social outcomes in Smith's theoretical framework.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity describes a long-term social pattern rather than an operational system component, making it difficult to map to any specific VSM system. It's more of a systemic outcome or emergent property than a functional element of economic organization.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural relationship between commercial development and social stratification patterns, explaining how different economic systems affect wealth concentration and family continuity. It reveals a non-obvious consequence of commercial society that connects economic and social dynamics.

Evaluation: Commercial Family Duration Pattern

definition_precision — 4.0 / 5.0

The definition clearly captures a specific empirical observation about wealth persistence patterns across different economic systems. It precisely contrasts commercial vs. agricultural societies and identifies the causal mechanism (extravagant spending vs. property consumability).

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's explicit observations in Book III, Chapter 4 about the rarity of old wealthy families in commercial countries versus their prevalence in non-commercial societies. The explanation about vanity, personal expense, and consumable property is faithful to Smith's analysis.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as this represents a broad sociological observation about commerce's effects on social structures rather than a specific economic mechanism. It bridges economic activity and social outcomes in Smith's theoretical framework.

vsm_relevance — 2.0 / 5.0

This entity describes a long-term social pattern rather than an operational system component, making it difficult to map to any specific VSM system. It's more of a systemic outcome or emergent property than a functional element of economic organization.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural relationship between commercial development and social stratification patterns, explaining how different economic systems affect wealth concentration and family continuity. It reveals a non-obvious consequence of commercial society that connects economic and social dynamics.

3.5 KiB Raw Blame History