Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

artificer_neighbourhood_settlement

null

2026-02-23T00:34:39.696816

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific settlement pattern with identifiable characteristics - skilled craftsmen clustering near agricultural areas due to mutual assistance needs and customer proximity. It avoids circularity and captures a distinct socio-economic phenomenon rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's discussion in Book III, Chapter 1 about how artificers naturally settle near agricultural communities and form the basis of market towns. The concept of mutual dependence and service requirements driving settlement patterns is explicitly present in Smith's analysis of urban formation.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Exchange" domain is appropriate since this settlement pattern facilitates trade between craftsmen and agricultural producers, and among craftsmen themselves. However, it could also reasonably fit in a "Social Organization" or "Urban Development" domain if those existed.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance as it represents an emergent organizational structure that enables coordination (S2) and operational efficiency (S1) through spatial proximity. However, it's more of a structural precondition for viable systems rather than a direct VSM component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the fundamental mechanism of how division of labor and market towns emerge from basic economic needs. It reveals the structural logic behind urban formation and the spatial organization of economic activity.

Evaluation: Artificer Neighbourhood Settlement

definition_precision — 4.0 / 5.0

The definition clearly describes a specific settlement pattern with identifiable characteristics - skilled craftsmen clustering near agricultural areas due to mutual assistance needs and customer proximity. It avoids circularity and captures a distinct socio-economic phenomenon rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's discussion in Book III, Chapter 1 about how artificers naturally settle near agricultural communities and form the basis of market towns. The concept of mutual dependence and service requirements driving settlement patterns is explicitly present in Smith's analysis of urban formation.

domain_placement — 4.0 / 5.0

The "Exchange" domain is appropriate since this settlement pattern facilitates trade between craftsmen and agricultural producers, and among craftsmen themselves. However, it could also reasonably fit in a "Social Organization" or "Urban Development" domain if those existed.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance as it represents an emergent organizational structure that enables coordination (S2) and operational efficiency (S1) through spatial proximity. However, it's more of a structural precondition for viable systems rather than a direct VSM component.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the fundamental mechanism of how division of labor and market towns emerge from basic economic needs. It reveals the structural logic behind urban formation and the spatial organization of economic activity.

3.6 KiB Raw Blame History