Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

labouring_poor

null

2026-02-23T05:39:47.228789

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific social class - wage earners including laborers, journeymen, and servants - and distinguishes them from other economic actors. While "servants of every kind" could be more precise, the core concept of wage-dependent workers is well-defined and non-circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, particularly Book I, Chapter 8, where he extensively discusses "the labouring poor" as a distinct class and emphasizes that their welfare is crucial to society's prosperity. Smith explicitly uses this terminology and devotes significant analysis to their circumstances.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Distribution" domain is highly appropriate since the labouring poor are central to Smith's analysis of how wages (a form of income distribution) are determined and distributed throughout society. This directly relates to how the fruits of economic activity are allocated among different classes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as the labouring poor represent the operational workforce that performs the fundamental productive activities of the economic system. They could also relate to S3 concerns regarding internal regulation of working conditions and wages.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides substantial explanatory power by identifying the key social class whose welfare Smith argues determines overall societal prosperity, and whose wage levels reflect the health of the economic system. It illuminates the structural relationship between labor compensation and economic growth rather than merely naming a demographic group.

Evaluation: Labouring Poor

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific social class - wage earners including laborers, journeymen, and servants - and distinguishes them from other economic actors. While "servants of every kind" could be more precise, the core concept of wage-dependent workers is well-defined and non-circular.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, particularly Book I, Chapter 8, where he extensively discusses "the labouring poor" as a distinct class and emphasizes that their welfare is crucial to society's prosperity. Smith explicitly uses this terminology and devotes significant analysis to their circumstances.

domain_placement — 5.0 / 5.0

Placement in the "Distribution" domain is highly appropriate since the labouring poor are central to Smith's analysis of how wages (a form of income distribution) are determined and distributed throughout society. This directly relates to how the fruits of economic activity are allocated among different classes.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as the labouring poor represent the operational workforce that performs the fundamental productive activities of the economic system. They could also relate to S3 concerns regarding internal regulation of working conditions and wages.

explanatory_value — 4.0 / 5.0

The entity provides substantial explanatory power by identifying the key social class whose welfare Smith argues determines overall societal prosperity, and whose wage levels reflect the health of the economic system. It illuminates the structural relationship between labor compensation and economic growth rather than merely naming a demographic group.

3.8 KiB Raw Blame History