Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

rude_produce

null

2026-02-23T06:19:43.269400

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes raw materials in their natural state from processed goods, providing specific examples (agricultural products, minerals, natural resources) and establishing the key criterion that these materials require further processing before consumption. The definition avoids circularity and captures a distinct economic concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book II, Chapter 5, where he explicitly discusses "rude produce" as part of his classification of capital employment and distinguishes it from manufactured goods. The concept and terminology are authentically Smithian rather than imposed interpretations.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is precisely correct, as rude produce represents the foundational stage of all productive economic activity. This placement accurately reflects Smith's understanding of raw materials as the starting point of the production process.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps naturally to S1 (primary operations) as it represents the fundamental operational inputs that enable all other economic activity. It also has relevance to S4 (environmental adaptation) since the availability and extraction of natural resources requires environmental intelligence and adaptation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory power by illuminating the foundational mechanism of economic activity - that all production begins with natural resource extraction and transformation. It reveals the structural relationship between raw materials and the entire economic system rather than merely naming a surface phenomenon.

Evaluation: Rude Produce

definition_precision — 4.0 / 5.0

The definition clearly distinguishes raw materials in their natural state from processed goods, providing specific examples (agricultural products, minerals, natural resources) and establishing the key criterion that these materials require further processing before consumption. The definition avoids circularity and captures a distinct economic concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book II, Chapter 5, where he explicitly discusses "rude produce" as part of his classification of capital employment and distinguishes it from manufactured goods. The concept and terminology are authentically Smithian rather than imposed interpretations.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is precisely correct, as rude produce represents the foundational stage of all productive economic activity. This placement accurately reflects Smith's understanding of raw materials as the starting point of the production process.

vsm_relevance — 4.0 / 5.0

This entity maps naturally to S1 (primary operations) as it represents the fundamental operational inputs that enable all other economic activity. It also has relevance to S4 (environmental adaptation) since the availability and extraction of natural resources requires environmental intelligence and adaptation.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory power by illuminating the foundational mechanism of economic activity - that all production begins with natural resource extraction and transformation. It reveals the structural relationship between raw materials and the entire economic system rather than merely naming a surface phenomenon.

3.8 KiB Raw Blame History