feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,63 @@
|
||||
---
|
||||
entity_slug: command_over_labour
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T04:57:07.938545'
|
||||
overall_score: 4.2
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly distinguishes "command over labour" as the power
|
||||
to direct others' work through wealth, measured by purchasable labour quantity.
|
||||
It avoids circularity and captures a distinct concept about economic power relationships.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is explicitly and extensively discussed in Book I, Chapter
|
||||
5 of The Wealth of Nations, where Smith argues that wealth should be measured
|
||||
by one's ability to command labour rather than by possession of goods alone. The
|
||||
entity accurately reflects Smith's actual theoretical framework.
|
||||
- name: domain_placement
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: '"Distribution" is the correct domain placement since this concept fundamentally
|
||||
concerns how economic power and resources are allocated between individuals in
|
||||
society. It directly relates to distributive relationships rather than production
|
||||
or exchange mechanisms.'
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: This concept has some relevance to S3 (internal regulation) as it describes
|
||||
power relationships within economic systems, but it's primarily a static measure
|
||||
of economic position rather than a dynamic system function. It doesn't map clearly
|
||||
to any single VSM system.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: "This entity illuminates a crucial structural mechanism in Smith's economic\
|
||||
\ theory\u2014how wealth translates into social and economic power through labour\
|
||||
\ command. It explains the underlying power dynamics that drive economic relationships\
|
||||
\ beyond mere commodity exchange."
|
||||
---
|
||||
|
||||
# Evaluation: Command Over Labour
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly distinguishes "command over labour" as the power to direct others' work through wealth, measured by purchasable labour quantity. It avoids circularity and captures a distinct concept about economic power relationships.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This concept is explicitly and extensively discussed in Book I, Chapter 5 of The Wealth of Nations, where Smith argues that wealth should be measured by one's ability to command labour rather than by possession of goods alone. The entity accurately reflects Smith's actual theoretical framework.
|
||||
|
||||
## domain_placement — 5.0 / 5.0
|
||||
|
||||
"Distribution" is the correct domain placement since this concept fundamentally concerns how economic power and resources are allocated between individuals in society. It directly relates to distributive relationships rather than production or exchange mechanisms.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
This concept has some relevance to S3 (internal regulation) as it describes power relationships within economic systems, but it's primarily a static measure of economic position rather than a dynamic system function. It doesn't map clearly to any single VSM system.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
This entity illuminates a crucial structural mechanism in Smith's economic theory—how wealth translates into social and economic power through labour command. It explains the underlying power dynamics that drive economic relationships beyond mere commodity exchange.
|
||||
Reference in New Issue
Block a user