feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: common_labour_wages
evaluator: null
evaluated_at: '2026-02-23T05:00:43.049149'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies common labour wages as compensation
for unskilled/semi-skilled manual work that serves as a baseline for wage comparisons.
It's precise and non-circular, though it could be slightly more specific about
what constitutes "basic manual tasks."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is thoroughly grounded in Smith's text, particularly in
Book I, Chapter 10, where he explicitly uses common labour wages as a comparative
benchmark throughout his analysis of wage differentials across occupations. The
context accurately reflects Smith's methodology of using this as a reference point.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: Placement in the "Distribution" domain is entirely appropriate, as wages
represent how the fruits of economic activity are distributed among participants.
This is a core distributional concept in Smith's framework.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily relating to S1 (primary
operations) as it concerns the basic compensation mechanism for operational work,
and potentially S3 (internal regulation) as a regulatory benchmark for wage setting.
However, it's more of an economic metric than a systemic function.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides significant explanatory value by illuminating the
mechanism Smith uses to analyze wage structures and occupational compensation
differentials. It reveals how economic comparison and relative valuation function
in labor markets, making it more than just a surface-level wage category.
---
# Evaluation: Common Labour Wages
## definition_precision — 4.0 / 5.0
The definition clearly identifies common labour wages as compensation for unskilled/semi-skilled manual work that serves as a baseline for wage comparisons. It's precise and non-circular, though it could be slightly more specific about what constitutes "basic manual tasks."
## source_grounding — 5.0 / 5.0
This concept is thoroughly grounded in Smith's text, particularly in Book I, Chapter 10, where he explicitly uses common labour wages as a comparative benchmark throughout his analysis of wage differentials across occupations. The context accurately reflects Smith's methodology of using this as a reference point.
## domain_placement — 5.0 / 5.0
Placement in the "Distribution" domain is entirely appropriate, as wages represent how the fruits of economic activity are distributed among participants. This is a core distributional concept in Smith's framework.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily relating to S1 (primary operations) as it concerns the basic compensation mechanism for operational work, and potentially S3 (internal regulation) as a regulatory benchmark for wage setting. However, it's more of an economic metric than a systemic function.
## explanatory_value — 4.0 / 5.0
This entity provides significant explanatory value by illuminating the mechanism Smith uses to analyze wage structures and occupational compensation differentials. It reveals how economic comparison and relative valuation function in labor markets, making it more than just a surface-level wage category.