feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: labouring_poor
evaluator: null
evaluated_at: '2026-02-23T05:39:47.228789'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies a specific social class - wage earners
including laborers, journeymen, and servants - and distinguishes them from other
economic actors. While "servants of every kind" could be more precise, the core
concept of wage-dependent workers is well-defined and non-circular.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text, particularly Book I,
Chapter 8, where he extensively discusses "the labouring poor" as a distinct class
and emphasizes that their welfare is crucial to society's prosperity. Smith explicitly
uses this terminology and devotes significant analysis to their circumstances.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: Placement in the "Distribution" domain is highly appropriate since the
labouring poor are central to Smith's analysis of how wages (a form of income
distribution) are determined and distributed throughout society. This directly
relates to how the fruits of economic activity are allocated among different classes.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S1 (primary operations) as the labouring poor
represent the operational workforce that performs the fundamental productive activities
of the economic system. They could also relate to S3 concerns regarding internal
regulation of working conditions and wages.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides substantial explanatory power by identifying the
key social class whose welfare Smith argues determines overall societal prosperity,
and whose wage levels reflect the health of the economic system. It illuminates
the structural relationship between labor compensation and economic growth rather
than merely naming a demographic group.
---
# Evaluation: Labouring Poor
## definition_precision — 4.0 / 5.0
The definition clearly identifies a specific social class - wage earners including laborers, journeymen, and servants - and distinguishes them from other economic actors. While "servants of every kind" could be more precise, the core concept of wage-dependent workers is well-defined and non-circular.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text, particularly Book I, Chapter 8, where he extensively discusses "the labouring poor" as a distinct class and emphasizes that their welfare is crucial to society's prosperity. Smith explicitly uses this terminology and devotes significant analysis to their circumstances.
## domain_placement — 5.0 / 5.0
Placement in the "Distribution" domain is highly appropriate since the labouring poor are central to Smith's analysis of how wages (a form of income distribution) are determined and distributed throughout society. This directly relates to how the fruits of economic activity are allocated among different classes.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S1 (primary operations) as the labouring poor represent the operational workforce that performs the fundamental productive activities of the economic system. They could also relate to S3 concerns regarding internal regulation of working conditions and wages.
## explanatory_value — 4.0 / 5.0
The entity provides substantial explanatory power by identifying the key social class whose welfare Smith argues determines overall societal prosperity, and whose wage levels reflect the health of the economic system. It illuminates the structural relationship between labor compensation and economic growth rather than merely naming a demographic group.