Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_labour

null

2026-02-23T00:27:27.148040

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes agricultural labour from manufacturing labour by identifying specific characteristics (seasonal variations, interconnected tasks, less amenable to division of labour). It captures a distinct concept rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual analysis in Book I, Chapter 1, where he explicitly contrasts agricultural and manufacturing labour regarding the division of labour. The definition accurately reflects Smith's observations about the structural differences between these types of work.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as agricultural labour is fundamentally about the production of food and raw materials. This is a core economic production category that fits naturally within Smith's framework.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Agricultural labour maps well to S1 (primary operations) as it represents fundamental productive activity, and potentially to S2 given Smith's emphasis on coordination challenges due to seasonal variations and task interconnectedness. The entity has clear VSM relevance rather than being too abstract.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating why certain sectors experience different productivity gains from division of labour, revealing structural mechanisms that affect economic efficiency. It goes beyond surface description to explain underlying economic dynamics.

Evaluation: Agricultural Labour

definition_precision — 4.0 / 5.0

The definition clearly distinguishes agricultural labour from manufacturing labour by identifying specific characteristics (seasonal variations, interconnected tasks, less amenable to division of labour). It captures a distinct concept rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual analysis in Book I, Chapter 1, where he explicitly contrasts agricultural and manufacturing labour regarding the division of labour. The definition accurately reflects Smith's observations about the structural differences between these types of work.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as agricultural labour is fundamentally about the production of food and raw materials. This is a core economic production category that fits naturally within Smith's framework.

vsm_relevance — 4.0 / 5.0

Agricultural labour maps well to S1 (primary operations) as it represents fundamental productive activity, and potentially to S2 given Smith's emphasis on coordination challenges due to seasonal variations and task interconnectedness. The entity has clear VSM relevance rather than being too abstract.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating why certain sectors experience different productivity gains from division of labour, revealing structural mechanisms that affect economic efficiency. It goes beyond surface description to explain underlying economic dynamics.

3.5 KiB Raw Blame History