Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

master_artificer

null

2026-02-23T05:49:31.066156

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes a master artificer as a skilled craftsman who employs capital, with specific characteristics regarding fixed vs. circulating capital usage. It avoids circularity and captures a distinct economic role, though it could be slightly more precise about what constitutes "skilled" in this context.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion in Book II, Chapter 1, where he explicitly uses master artificers as examples when analyzing the different proportions of fixed and circulating capital across various trades and occupations.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as master artificers are fundamentally engaged in the production of goods through skilled craftsmanship, representing a key category of productive labor in Smith's framework.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it represents a fundamental productive unit in the economic system. It also has some relevance to S3 (internal regulation) in terms of how capital allocation decisions are made within the craft operation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory value by illustrating the structural relationship between different types of capital usage across occupations, serving as a concrete example of Smith's broader theoretical framework about capital allocation and productive organization.

Evaluation: Master Artificer

definition_precision — 4.0 / 5.0

The definition clearly distinguishes a master artificer as a skilled craftsman who employs capital, with specific characteristics regarding fixed vs. circulating capital usage. It avoids circularity and captures a distinct economic role, though it could be slightly more precise about what constitutes "skilled" in this context.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion in Book II, Chapter 1, where he explicitly uses master artificers as examples when analyzing the different proportions of fixed and circulating capital across various trades and occupations.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as master artificers are fundamentally engaged in the production of goods through skilled craftsmanship, representing a key category of productive labor in Smith's framework.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it represents a fundamental productive unit in the economic system. It also has some relevance to S3 (internal regulation) in terms of how capital allocation decisions are made within the craft operation.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory value by illustrating the structural relationship between different types of capital usage across occupations, serving as a concrete example of Smith's broader theoretical framework about capital allocation and productive organization.

3.3 KiB Raw Blame History