feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,65 @@
|
||||
---
|
||||
entity_slug: unproductive_labourers
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T06:35:42.746621'
|
||||
overall_score: 4.0
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly distinguishes unproductive labourers as those
|
||||
whose work doesn't create vendible commodities but provides immediate services.
|
||||
The distinction between service provision and tangible good creation is precise
|
||||
and operationally meaningful.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is directly and extensively discussed in Book II, Chapter
|
||||
5 of The Wealth of Nations, where Smith explicitly categorizes different types
|
||||
of labour and provides detailed examples of unproductive versus productive work.
|
||||
The definition accurately reflects Smith's original formulation.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: '"General Theory" is the appropriate domain placement as this concept
|
||||
represents a fundamental theoretical distinction in Smith''s economic framework
|
||||
about the nature of labour and value creation. It''s a core analytical category
|
||||
rather than a specific mechanism or policy application.'
|
||||
- name: vsm_relevance
|
||||
value: 2.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is primarily a classificatory concept about types of labour
|
||||
rather than a systemic function or operational component. While unproductive labourers
|
||||
might work within various VSM systems, the concept itself doesn't naturally map
|
||||
to any specific VSM system and remains largely VSM-neutral.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides significant explanatory power by illuminating Smith's
|
||||
theory of capital accumulation and economic growth, explaining why certain types
|
||||
of labour contribute to wealth creation while others don't. It reveals a fundamental
|
||||
structural distinction in economic analysis rather than merely naming a surface
|
||||
phenomenon.
|
||||
---
|
||||
|
||||
# Evaluation: Unproductive Labourers
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly distinguishes unproductive labourers as those whose work doesn't create vendible commodities but provides immediate services. The distinction between service provision and tangible good creation is precise and operationally meaningful.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This concept is directly and extensively discussed in Book II, Chapter 5 of The Wealth of Nations, where Smith explicitly categorizes different types of labour and provides detailed examples of unproductive versus productive work. The definition accurately reflects Smith's original formulation.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
"General Theory" is the appropriate domain placement as this concept represents a fundamental theoretical distinction in Smith's economic framework about the nature of labour and value creation. It's a core analytical category rather than a specific mechanism or policy application.
|
||||
|
||||
## vsm_relevance — 2.0 / 5.0
|
||||
|
||||
This entity is primarily a classificatory concept about types of labour rather than a systemic function or operational component. While unproductive labourers might work within various VSM systems, the concept itself doesn't naturally map to any specific VSM system and remains largely VSM-neutral.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
This entity provides significant explanatory power by illuminating Smith's theory of capital accumulation and economic growth, explaining why certain types of labour contribute to wealth creation while others don't. It reveals a fundamental structural distinction in economic analysis rather than merely naming a surface phenomenon.
|
||||
Reference in New Issue
Block a user