Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

common_labour_wages

null

2026-02-23T05:00:43.049149

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies common labour wages as compensation for unskilled/semi-skilled manual work that serves as a baseline for wage comparisons. It's precise and non-circular, though it could be slightly more specific about what constitutes "basic manual tasks."

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is thoroughly grounded in Smith's text, particularly in Book I, Chapter 10, where he explicitly uses common labour wages as a comparative benchmark throughout his analysis of wage differentials across occupations. The context accurately reflects Smith's methodology of using this as a reference point.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Distribution" domain is entirely appropriate, as wages represent how the fruits of economic activity are distributed among participants. This is a core distributional concept in Smith's framework.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily relating to S1 (primary operations) as it concerns the basic compensation mechanism for operational work, and potentially S3 (internal regulation) as a regulatory benchmark for wage setting. However, it's more of an economic metric than a systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating the mechanism Smith uses to analyze wage structures and occupational compensation differentials. It reveals how economic comparison and relative valuation function in labor markets, making it more than just a surface-level wage category.

Evaluation: Common Labour Wages

definition_precision — 4.0 / 5.0

The definition clearly identifies common labour wages as compensation for unskilled/semi-skilled manual work that serves as a baseline for wage comparisons. It's precise and non-circular, though it could be slightly more specific about what constitutes "basic manual tasks."

source_grounding — 5.0 / 5.0

This concept is thoroughly grounded in Smith's text, particularly in Book I, Chapter 10, where he explicitly uses common labour wages as a comparative benchmark throughout his analysis of wage differentials across occupations. The context accurately reflects Smith's methodology of using this as a reference point.

domain_placement — 5.0 / 5.0

Placement in the "Distribution" domain is entirely appropriate, as wages represent how the fruits of economic activity are distributed among participants. This is a core distributional concept in Smith's framework.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily relating to S1 (primary operations) as it concerns the basic compensation mechanism for operational work, and potentially S3 (internal regulation) as a regulatory benchmark for wage setting. However, it's more of an economic metric than a systemic function.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating the mechanism Smith uses to analyze wage structures and occupational compensation differentials. It reveals how economic comparison and relative valuation function in labor markets, making it more than just a surface-level wage category.

3.5 KiB Raw Blame History