feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: demand_for_labour
evaluator: null
evaluated_at: '2026-02-23T05:05:36.113031'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies demand for labour as the need for workers
that increases with revenue and stock, and explicitly states it regulates production
of men like any other commodity. While comprehensive, the phrase "various employments"
could be more specific about what constitutes different types of labour demand.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Book I, Chapter 8 of The Wealth
of Nations, where Smith explicitly discusses how demand for labour increases with
national wealth and regulates wages. The definition accurately reflects Smith's
actual argument about labour demand as a key economic mechanism.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the correct domain placement as demand for labour
represents a fundamental theoretical principle that underpins Smith''s broader
analysis of wage determination and economic growth. This is clearly a core theoretical
concept rather than a specific application or institutional arrangement.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance as it could map to S1 (primary
operations of labour allocation) or S4 (intelligence about environmental labour
needs). However, it's somewhat abstract as a general economic force rather than
a specific organizational function or information flow.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory value by illuminating the
fundamental mechanism that Smith argues drives wage variations across time and
place. It reveals the structural relationship between national wealth accumulation
and labour market dynamics, making it a key explanatory concept rather than merely
descriptive.
---
# Evaluation: Demand For Labour
## definition_precision — 4.0 / 5.0
The definition clearly identifies demand for labour as the need for workers that increases with revenue and stock, and explicitly states it regulates production of men like any other commodity. While comprehensive, the phrase "various employments" could be more specific about what constitutes different types of labour demand.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Book I, Chapter 8 of The Wealth of Nations, where Smith explicitly discusses how demand for labour increases with national wealth and regulates wages. The definition accurately reflects Smith's actual argument about labour demand as a key economic mechanism.
## domain_placement — 5.0 / 5.0
"General Theory" is the correct domain placement as demand for labour represents a fundamental theoretical principle that underpins Smith's broader analysis of wage determination and economic growth. This is clearly a core theoretical concept rather than a specific application or institutional arrangement.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance as it could map to S1 (primary operations of labour allocation) or S4 (intelligence about environmental labour needs). However, it's somewhat abstract as a general economic force rather than a specific organizational function or information flow.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory value by illuminating the fundamental mechanism that Smith argues drives wage variations across time and place. It reveals the structural relationship between national wealth accumulation and labour market dynamics, making it a key explanatory concept rather than merely descriptive.