Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

piece_work_wages

null

2026-02-23T06:05:51.799038

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes piece-work wages from time-based compensation and captures the key mechanism (payment by output rather than time) along with Smith's observations about behavioral effects. It's precise and non-circular, though could be slightly more specific about what constitutes "the piece."

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text from Book I, Chapter 8, where he explicitly discusses piece-work compensation and its effects on worker behavior and health. The definition accurately reflects Smith's actual observations rather than imposing modern interpretations.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Distribution" domain is correct, as piece-work wages represent a specific mechanism for distributing compensation to workers based on their productive output. This fits naturally within Smith's broader analysis of how income is allocated among different factors of production.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it describes how operational work is compensated and incentivized. It also touches on S2 (coordination) through its effects on worker behavior and productivity regulation, but the mapping is not as direct as more structural economic concepts.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating the mechanism through which different compensation structures affect worker incentives, productivity, and well-being. It reveals an important structural relationship between payment methods and economic behavior rather than merely naming a surface phenomenon.

Evaluation: Piece Work Wages

definition_precision — 4.0 / 5.0

The definition clearly distinguishes piece-work wages from time-based compensation and captures the key mechanism (payment by output rather than time) along with Smith's observations about behavioral effects. It's precise and non-circular, though could be slightly more specific about what constitutes "the piece."

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text from Book I, Chapter 8, where he explicitly discusses piece-work compensation and its effects on worker behavior and health. The definition accurately reflects Smith's actual observations rather than imposing modern interpretations.

domain_placement — 5.0 / 5.0

Placement in the "Distribution" domain is correct, as piece-work wages represent a specific mechanism for distributing compensation to workers based on their productive output. This fits naturally within Smith's broader analysis of how income is allocated among different factors of production.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it describes how operational work is compensated and incentivized. It also touches on S2 (coordination) through its effects on worker behavior and productivity regulation, but the mapping is not as direct as more structural economic concepts.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating the mechanism through which different compensation structures affect worker incentives, productivity, and well-being. It reveals an important structural relationship between payment methods and economic behavior rather than merely naming a surface phenomenon.

3.7 KiB Raw Blame History