Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

manufactured_produce

null

2026-02-23T05:41:53.730998

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes manufactured produce from rude produce by emphasizing the transformation through human labor and tools. It avoids circularity and captures the essential concept of value-added processing that makes goods suitable for consumption.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book II, Chapter 5, where he explicitly discusses manufacturing as a method of employing capital and emphasizes how it transforms raw materials into consumable goods. The definition accurately reflects Smith's distinction between rude and manufactured produce.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is perfectly appropriate, as manufactured produce represents a core production process in Smith's economic framework. This concept sits at the heart of how labor and capital transform raw materials into valuable goods.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it represents the fundamental productive activities that transform inputs into outputs. It could also relate to S3 (internal regulation) in terms of quality control and production standards within manufacturing processes.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory power by illuminating the mechanism through which raw materials gain exchange value and become useful to society. It helps explain a crucial link in Smith's theory of how labor creates value and drives economic activity.

Evaluation: Manufactured Produce

definition_precision — 4.0 / 5.0

The definition clearly distinguishes manufactured produce from rude produce by emphasizing the transformation through human labor and tools. It avoids circularity and captures the essential concept of value-added processing that makes goods suitable for consumption.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book II, Chapter 5, where he explicitly discusses manufacturing as a method of employing capital and emphasizes how it transforms raw materials into consumable goods. The definition accurately reflects Smith's distinction between rude and manufactured produce.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is perfectly appropriate, as manufactured produce represents a core production process in Smith's economic framework. This concept sits at the heart of how labor and capital transform raw materials into valuable goods.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it represents the fundamental productive activities that transform inputs into outputs. It could also relate to S3 (internal regulation) in terms of quality control and production standards within manufacturing processes.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory power by illuminating the mechanism through which raw materials gain exchange value and become useful to society. It helps explain a crucial link in Smith's theory of how labor creates value and drives economic activity.

3.4 KiB Raw Blame History