Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

artificer_planter_transition

null

2026-02-23T00:34:57.529156

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific economic behavior pattern - skilled craftsmen abandoning their trades for agriculture when they acquire capital. The concept is well-bounded and distinct, though it could be slightly more precise about the threshold conditions that trigger this transition.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion in Book III, Chapter 1, where he explicitly describes how artificers in colonies prefer to become planters when they can afford land. Smith uses this phenomenon to illustrate the natural preference for agricultural independence over manufacturing dependence.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as this represents a broader principle about human economic preferences and colonial development patterns. However, it could arguably fit in a more specific domain like "Colonial Economics" or "Labor Allocation" if such categories existed.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it describes how individuals adapt their economic roles based on changing circumstances and opportunities. It also touches on S1 (operations) regarding the actual shift in productive activities.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating why manufacturing develops slowly in colonies despite available skilled labor - it reveals an underlying preference structure that drives economic behavior. This goes beyond surface description to explain a structural economic mechanism.

Evaluation: Artificer Planter Transition

definition_precision — 4.0 / 5.0

The definition clearly describes a specific economic behavior pattern - skilled craftsmen abandoning their trades for agriculture when they acquire capital. The concept is well-bounded and distinct, though it could be slightly more precise about the threshold conditions that trigger this transition.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion in Book III, Chapter 1, where he explicitly describes how artificers in colonies prefer to become planters when they can afford land. Smith uses this phenomenon to illustrate the natural preference for agricultural independence over manufacturing dependence.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as this represents a broader principle about human economic preferences and colonial development patterns. However, it could arguably fit in a more specific domain like "Colonial Economics" or "Labor Allocation" if such categories existed.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it describes how individuals adapt their economic roles based on changing circumstances and opportunities. It also touches on S1 (operations) regarding the actual shift in productive activities.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating why manufacturing develops slowly in colonies despite available skilled labor - it reveals an underlying preference structure that drives economic behavior. This goes beyond surface description to explain a structural economic mechanism.

3.7 KiB Raw Blame History