Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

country_life_charms

null

2026-02-23T05:04:10.194404

3.8

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific non-economic attractions (beauty, pleasure, tranquility, independence) that distinguish country life charms from purely economic motivations. While somewhat descriptive, it captures a distinct concept about the qualitative appeal of rural life.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion in Book III, Chapter 1, where he explicitly describes the "charms of country life" and their role in maintaining agricultural preferences. The concept directly reflects Smith's own language and reasoning about non-economic factors in agricultural investment.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since this concept explains broader patterns of human economic behavior beyond specific agricultural mechanics. It represents a theoretical insight about how non-economic factors influence economic choices across different stages of development.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is largely VSM-neutral as it describes cultural/psychological preferences rather than operational or regulatory mechanisms. While it might loosely relate to S4 (environmental factors influencing system adaptation), it doesn't map naturally to any specific VSM system function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by identifying non-economic factors that help explain persistent agricultural preferences despite economic incentives favoring other sectors. It illuminates an important mechanism in Smith's theory of how human motivations beyond profit shape economic development patterns.

Evaluation: Country Life Charms

definition_precision — 4.0 / 5.0

The definition clearly identifies specific non-economic attractions (beauty, pleasure, tranquility, independence) that distinguish country life charms from purely economic motivations. While somewhat descriptive, it captures a distinct concept about the qualitative appeal of rural life.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion in Book III, Chapter 1, where he explicitly describes the "charms of country life" and their role in maintaining agricultural preferences. The concept directly reflects Smith's own language and reasoning about non-economic factors in agricultural investment.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since this concept explains broader patterns of human economic behavior beyond specific agricultural mechanics. It represents a theoretical insight about how non-economic factors influence economic choices across different stages of development.

vsm_relevance — 2.0 / 5.0

This entity is largely VSM-neutral as it describes cultural/psychological preferences rather than operational or regulatory mechanisms. While it might loosely relate to S4 (environmental factors influencing system adaptation), it doesn't map naturally to any specific VSM system function.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by identifying non-economic factors that help explain persistent agricultural preferences despite economic incentives favoring other sectors. It illuminates an important mechanism in Smith's theory of how human motivations beyond profit shape economic development patterns.

3.6 KiB Raw Blame History