Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

artisan_specialisation

null

2026-02-23T00:35:46.299833

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes artisan specialisation from general division of labor by emphasizing the market demand threshold needed to support dedicated practitioners. It avoids circularity and captures the specific mechanism of skilled workers concentrating on single crafts when markets are sufficiently large.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 3, with specific examples of smiths, carpenters, and masons in remote versus populous areas. The concept accurately reflects Smith's discussion of how market extent enables craft specialisation.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain placement as this concept deals with how goods are made and the organization of productive activities. Artisan specialisation is fundamentally about production methods and the structure of manufacturing processes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it describes how basic productive work is organized and carried out. It also has some relevance to S4 (intelligence) since market sensing determines when specialisation becomes viable.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural mechanism - how market size creates conditions for productive efficiency through specialisation. It explains the relationship between market extent and production organization, providing genuine insight into economic development patterns.

Evaluation: Artisan Specialisation

definition_precision — 4.0 / 5.0

The definition clearly distinguishes artisan specialisation from general division of labor by emphasizing the market demand threshold needed to support dedicated practitioners. It avoids circularity and captures the specific mechanism of skilled workers concentrating on single crafts when markets are sufficiently large.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 3, with specific examples of smiths, carpenters, and masons in remote versus populous areas. The concept accurately reflects Smith's discussion of how market extent enables craft specialisation.

domain_placement — 5.0 / 5.0

"Production" is the correct domain placement as this concept deals with how goods are made and the organization of productive activities. Artisan specialisation is fundamentally about production methods and the structure of manufacturing processes.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it describes how basic productive work is organized and carried out. It also has some relevance to S4 (intelligence) since market sensing determines when specialisation becomes viable.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural mechanism - how market size creates conditions for productive efficiency through specialisation. It explains the relationship between market extent and production organization, providing genuine insight into economic development patterns.

3.4 KiB Raw Blame History