Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

merchant_country_gentleman_transition

null

2026-02-23T05:51:33.487670

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly describing a specific social mobility pattern where merchants transition to landownership and bring commercial practices to agriculture. It avoids circularity and captures a distinct socioeconomic phenomenon rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text from Book III, Chapter 4, where he explicitly discusses how merchants who acquire country estates become more effective land improvers than traditional gentlemen. The description accurately reflects Smith's analysis of this transition mechanism.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placement in "Distribution" is reasonable since this involves the redistribution of land ownership and the flow of capital from commerce to agriculture. However, it could also fit in a broader economic development or social transformation category.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/adaptation) as merchants bring new knowledge and practices to agriculture, or S1 (operations) as it represents a change in how agricultural production is managed. However, it's primarily a social transition rather than a clear systemic function.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by illuminating a specific mechanism through which commercial development improves agricultural productivity. It reveals the structural relationship between urban commerce and rural improvement through human capital transfer.

Evaluation: Merchant Country Gentleman Transition

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly describing a specific social mobility pattern where merchants transition to landownership and bring commercial practices to agriculture. It avoids circularity and captures a distinct socioeconomic phenomenon rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text from Book III, Chapter 4, where he explicitly discusses how merchants who acquire country estates become more effective land improvers than traditional gentlemen. The description accurately reflects Smith's analysis of this transition mechanism.

domain_placement — 4.0 / 5.0

Placement in "Distribution" is reasonable since this involves the redistribution of land ownership and the flow of capital from commerce to agriculture. However, it could also fit in a broader economic development or social transformation category.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/adaptation) as merchants bring new knowledge and practices to agriculture, or S1 (operations) as it represents a change in how agricultural production is managed. However, it's primarily a social transition rather than a clear systemic function.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by illuminating a specific mechanism through which commercial development improves agricultural productivity. It reveals the structural relationship between urban commerce and rural improvement through human capital transfer.

3.5 KiB Raw Blame History