Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

subsistence_agriculture

null

2026-02-23T06:26:46.278382

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes subsistence agriculture from market-oriented agriculture based on the primary purpose (family consumption vs. market exchange). It precisely identifies the key mechanism - prevention of specialization due to self-sufficiency requirements.

name	value	max_value	rationale
source_grounding	5.0	5.0	The entity is directly grounded in Smith's specific example of Scottish Highland farmers who must be "butcher, baker, and brewer for his own family." This illustrates Smith's broader point about how market access limitations prevent division of labour.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain placement since subsistence agriculture represents a specific mode of organizing productive activities. It fundamentally concerns how goods are produced and for what purpose (subsistence vs. exchange).

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps primarily to S1 (primary operations) as it describes a basic production system, but it's somewhat VSM-neutral since it represents a pre-systemic or simplified organizational form. The lack of specialization means other VSM functions (coordination, regulation, intelligence) are underdeveloped.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory power by illustrating the structural relationship between market access, specialization, and productivity. It demonstrates how geographic and economic constraints create self-reinforcing cycles that limit economic development through reduced division of labour.

Evaluation: Subsistence Agriculture

definition_precision — 4.0 / 5.0

The definition clearly distinguishes subsistence agriculture from market-oriented agriculture based on the primary purpose (family consumption vs. market exchange). It precisely identifies the key mechanism - prevention of specialization due to self-sufficiency requirements.

source_grounding — 5.0 / 5.0

The entity is directly grounded in Smith's specific example of Scottish Highland farmers who must be "butcher, baker, and brewer for his own family." This illustrates Smith's broader point about how market access limitations prevent division of labour.

domain_placement — 5.0 / 5.0

"Production" is the correct domain placement since subsistence agriculture represents a specific mode of organizing productive activities. It fundamentally concerns how goods are produced and for what purpose (subsistence vs. exchange).

vsm_relevance — 3.0 / 5.0

This entity maps primarily to S1 (primary operations) as it describes a basic production system, but it's somewhat VSM-neutral since it represents a pre-systemic or simplified organizational form. The lack of specialization means other VSM functions (coordination, regulation, intelligence) are underdeveloped.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory power by illustrating the structural relationship between market access, specialization, and productivity. It demonstrates how geographic and economic constraints create self-reinforcing cycles that limit economic development through reduced division of labour.

3.4 KiB Raw Blame History