Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

master_manufacturer

null

2026-02-23T05:49:41.130616

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly identifying the master manufacturer as an employer who advances capital (materials, wages, maintenance) and extracts profit as a "second deduction" from labor's produce. The concept is distinct and non-circular, though it could be slightly more specific about the manufacturing context.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 8, where he explicitly discusses how employers advance capital to workers and take profit as their share. The language of "deductions from the produce of labour" closely mirrors Smith's own terminology.

name	value	max_value	rationale
domain_placement	3.0	5.0	While "Distribution" captures the profit-sharing aspect, this entity seems more fundamentally about production organization and capital-labor relations. A domain like "Production" or "Capital Relations" might be more appropriate than Distribution.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S1 (primary operations) as the master manufacturer directly organizes productive activities, and potentially to S3 (internal regulation) through their role in coordinating and controlling the production process. The entity has clear operational relevance to VSM systems.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial structural mechanism in Smith's analysis - how capital organizes labor and extracts surplus value through the advance-profit relationship. It reveals the fundamental power dynamic between capital and labor in manufacturing.

Evaluation: Master Manufacturer

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly identifying the master manufacturer as an employer who advances capital (materials, wages, maintenance) and extracts profit as a "second deduction" from labor's produce. The concept is distinct and non-circular, though it could be slightly more specific about the manufacturing context.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 8, where he explicitly discusses how employers advance capital to workers and take profit as their share. The language of "deductions from the produce of labour" closely mirrors Smith's own terminology.

domain_placement — 3.0 / 5.0

While "Distribution" captures the profit-sharing aspect, this entity seems more fundamentally about production organization and capital-labor relations. A domain like "Production" or "Capital Relations" might be more appropriate than Distribution.

vsm_relevance — 4.0 / 5.0

This maps well to S1 (primary operations) as the master manufacturer directly organizes productive activities, and potentially to S3 (internal regulation) through their role in coordinating and controlling the production process. The entity has clear operational relevance to VSM systems.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial structural mechanism in Smith's analysis - how capital organizes labor and extracts surplus value through the advance-profit relationship. It reveals the fundamental power dynamic between capital and labor in manufacturing.

3.5 KiB Raw Blame History