Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

complete_manufacture

null

2026-02-23T05:01:44.451170

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes "complete manufacture" as the finished product at the end of the production process, before market exchange. It avoids circularity and captures a distinct stage in the production chain.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion in Book I, Chapter 6 about how manufactured goods' prices must account for materials, wages, and profits. The concept emerges naturally from Smith's analysis of production stages and pricing.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain assignment, as this entity specifically concerns the output stage of the manufacturing process. It fits perfectly within production theory rather than exchange, distribution, or other economic domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations) as it represents the actual output of productive operations. It could also relate to S3 (internal regulation) in terms of quality control and completion standards for manufactured goods.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural relation in Smith's production theory—the distinction between intermediate and final stages of manufacturing. It helps explain how pricing mechanisms must account for the full production process from raw materials to finished goods.

Evaluation: Complete Manufacture

definition_precision — 4.0 / 5.0

The definition clearly distinguishes "complete manufacture" as the finished product at the end of the production process, before market exchange. It avoids circularity and captures a distinct stage in the production chain.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion in Book I, Chapter 6 about how manufactured goods' prices must account for materials, wages, and profits. The concept emerges naturally from Smith's analysis of production stages and pricing.

domain_placement — 5.0 / 5.0

"Production" is the correct domain assignment, as this entity specifically concerns the output stage of the manufacturing process. It fits perfectly within production theory rather than exchange, distribution, or other economic domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations) as it represents the actual output of productive operations. It could also relate to S3 (internal regulation) in terms of quality control and completion standards for manufactured goods.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural relation in Smith's production theory—the distinction between intermediate and final stages of manufacturing. It helps explain how pricing mechanisms must account for the full production process from raw materials to finished goods.

3.1 KiB Raw Blame History