Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

machinery_invention

null

2026-02-23T05:41:35.790541

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying machinery invention as the creation of mechanical devices that facilitate labor through the division of labor process. It avoids circularity and captures a distinct concept, though it could be slightly more precise about what constitutes "facilitating and abridging" labor.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 1, where he explicitly identifies machinery invention as the third consequence of division of labor. The definition accurately reflects Smith's argument that workers' concentrated attention on specific tasks leads to mechanical improvements.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as machinery invention directly relates to how goods are produced and represents a fundamental aspect of productive processes. This is clearly a production-focused concept rather than belonging to exchange, distribution, or consumption domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it directly affects how productive work is performed, and potentially to S4 (intelligence/adaptation) as it represents innovation and environmental response. The concept has clear operational implications within a viable system framework.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating a specific mechanism through which division of labor leads to technological progress and productivity gains. It reveals a structural relationship between work specialization and innovation rather than merely naming a surface phenomenon.

Evaluation: Machinery Invention

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying machinery invention as the creation of mechanical devices that facilitate labor through the division of labor process. It avoids circularity and captures a distinct concept, though it could be slightly more precise about what constitutes "facilitating and abridging" labor.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 1, where he explicitly identifies machinery invention as the third consequence of division of labor. The definition accurately reflects Smith's argument that workers' concentrated attention on specific tasks leads to mechanical improvements.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as machinery invention directly relates to how goods are produced and represents a fundamental aspect of productive processes. This is clearly a production-focused concept rather than belonging to exchange, distribution, or consumption domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it directly affects how productive work is performed, and potentially to S4 (intelligence/adaptation) as it represents innovation and environmental response. The concept has clear operational implications within a viable system framework.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating a specific mechanism through which division of labor leads to technological progress and productivity gains. It reveals a structural relationship between work specialization and innovation rather than merely naming a surface phenomenon.

3.7 KiB Raw Blame History