Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

natural_division_of_labour

null

2026-02-23T05:58:46.512863

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes natural division of labour from artificial arrangements by emphasizing spontaneous organization based on market forces and comparative advantages. It avoids circularity and captures a distinct concept about optimal resource allocation without regulatory distortion.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion of drawbacks in Book IV, Chapter 4, where he explicitly argues that such policies preserve the "natural" division of labour against artificial distortions. The concept reflects Smith's core distinction between natural market outcomes and policy interventions.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain is entirely appropriate since this concept deals with how economic activities organize themselves into specialized tasks and optimal allocation of productive resources. This is fundamentally about the structure and organization of production processes.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as the fundamental operational structure) and S4 (as an emergent intelligence about optimal organization). However, it represents more of a systemic property than a discrete functional component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory power by illuminating the mechanism through which markets naturally organize productive activities and how policy interventions can either preserve or distort this organization. It reveals an important structural principle underlying Smith's economic theory.

Evaluation: Natural Division Of Labour

definition_precision — 4.0 / 5.0

The definition clearly distinguishes natural division of labour from artificial arrangements by emphasizing spontaneous organization based on market forces and comparative advantages. It avoids circularity and captures a distinct concept about optimal resource allocation without regulatory distortion.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion of drawbacks in Book IV, Chapter 4, where he explicitly argues that such policies preserve the "natural" division of labour against artificial distortions. The concept reflects Smith's core distinction between natural market outcomes and policy interventions.

domain_placement — 5.0 / 5.0

The "Production" domain is entirely appropriate since this concept deals with how economic activities organize themselves into specialized tasks and optimal allocation of productive resources. This is fundamentally about the structure and organization of production processes.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as the fundamental operational structure) and S4 (as an emergent intelligence about optimal organization). However, it represents more of a systemic property than a discrete functional component.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory power by illuminating the mechanism through which markets naturally organize productive activities and how policy interventions can either preserve or distort this organization. It reveals an important structural principle underlying Smith's economic theory.

3.6 KiB Raw Blame History