Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

artificer_servant_status

null

2026-02-23T00:35:06.243951

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes artificers as skilled craftsmen dependent on customers for subsistence, contrasting them with independent agricultural producers. The concept is well-bounded and non-circular, though it could be slightly more precise about what constitutes "skilled craftsmen."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion in Book III, Chapter 1, where he explicitly contrasts the dependent status of artificers with the independence of agricultural producers and explains why artificers in colonies prefer to become planters. The concept emerges clearly from the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept addresses fundamental economic relationships between different types of producers and their modes of subsistence. It represents a core theoretical distinction in Smith's analysis of economic development patterns.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as it describes primary economic operations and producer relationships) and S4 (as it relates to adaptation patterns in colonial environments). However, it's more of a structural economic relationship than a clear system function.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the mechanism behind occupational choices and economic development patterns in colonies. It reveals how dependency relationships drive economic behavior and shape territorial development, making it a valuable analytical concept.

Evaluation: Artificer Servant Status

definition_precision — 4.0 / 5.0

The definition clearly distinguishes artificers as skilled craftsmen dependent on customers for subsistence, contrasting them with independent agricultural producers. The concept is well-bounded and non-circular, though it could be slightly more precise about what constitutes "skilled craftsmen."

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion in Book III, Chapter 1, where he explicitly contrasts the dependent status of artificers with the independence of agricultural producers and explains why artificers in colonies prefer to become planters. The concept emerges clearly from the source text.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept addresses fundamental economic relationships between different types of producers and their modes of subsistence. It represents a core theoretical distinction in Smith's analysis of economic development patterns.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as it describes primary economic operations and producer relationships) and S4 (as it relates to adaptation patterns in colonial environments). However, it's more of a structural economic relationship than a clear system function.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the mechanism behind occupational choices and economic development patterns in colonies. It reveals how dependency relationships drive economic behavior and shape territorial development, making it a valuable analytical concept.

3.6 KiB Raw Blame History