feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,62 @@
|
||||
---
|
||||
entity_slug: wages_of_a_journeyman
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T06:37:45.796765'
|
||||
overall_score: 4.0
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly distinguishes wages of journeymen as compensation
|
||||
for skilled labor under master craftsmen, separate from profits. It's precise
|
||||
and non-circular, though could be slightly more specific about what constitutes
|
||||
"skilled" versus other types of labor.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is directly grounded in Smith's text from Book I, Chapter
|
||||
6, where he explicitly discusses journeymen's wages in contrast to masters' profits.
|
||||
The entity accurately reflects Smith's actual terminology and analytical framework.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: Placement in "Distribution" is correct, as wages represent one of the
|
||||
primary categories of income distribution in Smith's framework alongside rent
|
||||
and profit. This is a core distributional concept rather than production or exchange.
|
||||
- name: vsm_relevance
|
||||
value: 2.0
|
||||
max_value: 5.0
|
||||
rationale: This entity represents a static income category rather than a dynamic
|
||||
system function, making it largely VSM-neutral. While journeymen operate within
|
||||
S1 (primary operations), the wage concept itself doesn't map naturally to VSM
|
||||
systems.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: "The entity illuminates an important structural relation in Smith's analysis\u2014\
|
||||
how labor compensation differs from entrepreneurial returns and how independent\
|
||||
\ manufacturers can earn both. It helps explain the mechanics of income distribution\
|
||||
\ in different organizational forms."
|
||||
---
|
||||
|
||||
# Evaluation: Wages Of A Journeyman
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly distinguishes wages of journeymen as compensation for skilled labor under master craftsmen, separate from profits. It's precise and non-circular, though could be slightly more specific about what constitutes "skilled" versus other types of labor.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This concept is directly grounded in Smith's text from Book I, Chapter 6, where he explicitly discusses journeymen's wages in contrast to masters' profits. The entity accurately reflects Smith's actual terminology and analytical framework.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
Placement in "Distribution" is correct, as wages represent one of the primary categories of income distribution in Smith's framework alongside rent and profit. This is a core distributional concept rather than production or exchange.
|
||||
|
||||
## vsm_relevance — 2.0 / 5.0
|
||||
|
||||
This entity represents a static income category rather than a dynamic system function, making it largely VSM-neutral. While journeymen operate within S1 (primary operations), the wage concept itself doesn't map naturally to VSM systems.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
The entity illuminates an important structural relation in Smith's analysis—how labor compensation differs from entrepreneurial returns and how independent manufacturers can earn both. It helps explain the mechanics of income distribution in different organizational forms.
|
||||
Reference in New Issue
Block a user