feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: artificer_neighbourhood_settlement
evaluator: null
evaluated_at: '2026-02-23T00:34:39.696816'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly describes a specific settlement pattern with identifiable
characteristics - skilled craftsmen clustering near agricultural areas due to
mutual assistance needs and customer proximity. It avoids circularity and captures
a distinct socio-economic phenomenon rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity directly reflects Smith's discussion in Book III, Chapter
1 about how artificers naturally settle near agricultural communities and form
the basis of market towns. The concept of mutual dependence and service requirements
driving settlement patterns is explicitly present in Smith's analysis of urban
formation.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Exchange" domain is appropriate since this settlement pattern facilitates
trade between craftsmen and agricultural producers, and among craftsmen themselves.
However, it could also reasonably fit in a "Social Organization" or "Urban Development"
domain if those existed.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance as it represents an emergent organizational
structure that enables coordination (S2) and operational efficiency (S1) through
spatial proximity. However, it's more of a structural precondition for viable
systems rather than a direct VSM component.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory power by illuminating the
fundamental mechanism of how division of labor and market towns emerge from basic
economic needs. It reveals the structural logic behind urban formation and the
spatial organization of economic activity.
---
# Evaluation: Artificer Neighbourhood Settlement
## definition_precision — 4.0 / 5.0
The definition clearly describes a specific settlement pattern with identifiable characteristics - skilled craftsmen clustering near agricultural areas due to mutual assistance needs and customer proximity. It avoids circularity and captures a distinct socio-economic phenomenon rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity directly reflects Smith's discussion in Book III, Chapter 1 about how artificers naturally settle near agricultural communities and form the basis of market towns. The concept of mutual dependence and service requirements driving settlement patterns is explicitly present in Smith's analysis of urban formation.
## domain_placement — 4.0 / 5.0
The "Exchange" domain is appropriate since this settlement pattern facilitates trade between craftsmen and agricultural producers, and among craftsmen themselves. However, it could also reasonably fit in a "Social Organization" or "Urban Development" domain if those existed.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance as it represents an emergent organizational structure that enables coordination (S2) and operational efficiency (S1) through spatial proximity. However, it's more of a structural precondition for viable systems rather than a direct VSM component.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory power by illuminating the fundamental mechanism of how division of labor and market towns emerge from basic economic needs. It reveals the structural logic behind urban formation and the spatial organization of economic activity.