Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

demand_for_labour

null

2026-02-23T05:05:36.113031

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies demand for labour as the need for workers that increases with revenue and stock, and explicitly states it regulates production of men like any other commodity. While comprehensive, the phrase "various employments" could be more specific about what constitutes different types of labour demand.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Book I, Chapter 8 of The Wealth of Nations, where Smith explicitly discusses how demand for labour increases with national wealth and regulates wages. The definition accurately reflects Smith's actual argument about labour demand as a key economic mechanism.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the correct domain placement as demand for labour represents a fundamental theoretical principle that underpins Smith's broader analysis of wage determination and economic growth. This is clearly a core theoretical concept rather than a specific application or institutional arrangement.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance as it could map to S1 (primary operations of labour allocation) or S4 (intelligence about environmental labour needs). However, it's somewhat abstract as a general economic force rather than a specific organizational function or information flow.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by illuminating the fundamental mechanism that Smith argues drives wage variations across time and place. It reveals the structural relationship between national wealth accumulation and labour market dynamics, making it a key explanatory concept rather than merely descriptive.

Evaluation: Demand For Labour

definition_precision — 4.0 / 5.0

The definition clearly identifies demand for labour as the need for workers that increases with revenue and stock, and explicitly states it regulates production of men like any other commodity. While comprehensive, the phrase "various employments" could be more specific about what constitutes different types of labour demand.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Book I, Chapter 8 of The Wealth of Nations, where Smith explicitly discusses how demand for labour increases with national wealth and regulates wages. The definition accurately reflects Smith's actual argument about labour demand as a key economic mechanism.

domain_placement — 5.0 / 5.0

"General Theory" is the correct domain placement as demand for labour represents a fundamental theoretical principle that underpins Smith's broader analysis of wage determination and economic growth. This is clearly a core theoretical concept rather than a specific application or institutional arrangement.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance as it could map to S1 (primary operations of labour allocation) or S4 (intelligence about environmental labour needs). However, it's somewhat abstract as a general economic force rather than a specific organizational function or information flow.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by illuminating the fundamental mechanism that Smith argues drives wage variations across time and place. It reveals the structural relationship between national wealth accumulation and labour market dynamics, making it a key explanatory concept rather than merely descriptive.

3.7 KiB Raw Blame History