Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

prime_cost_of_commodities

null

2026-02-23T06:08:39.056897

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept - production cost excluding reseller profit - but the second clause about "economic analysis" creates some confusion about whether this is a descriptive or normative concept. The core distinction is clear but could be more precisely articulated.

name	value	max_value	rationale
source_grounding	5.0	5.0	The entity is directly grounded in Smith's text with an exact quotation provided, showing this is a concept Smith explicitly discusses rather than an interpretive overlay. The distinction between prime cost and natural price appears to be authentic to the source.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Production" is an appropriate domain since prime cost relates to manufacturing/creation costs, though it could arguably fit in a "Pricing" or "Cost Structure" domain since it's fundamentally about how different cost components relate to final prices. The placement is reasonable but not uniquely correct.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S1 (primary operations) as it concerns the fundamental cost structure of productive activities, and potentially to S3 (internal regulation) as it relates to cost accounting and control mechanisms. It has clear operational relevance rather than being abstractly theoretical.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This concept illuminates an important structural distinction in how costs accumulate through supply chains, helping explain why prices must exceed production costs to sustain commerce. It reveals a key mechanism in price formation rather than just labeling a surface phenomenon.

Evaluation: Prime Cost Of Commodities

definition_precision — 3.0 / 5.0

The definition captures a distinct concept - production cost excluding reseller profit - but the second clause about "economic analysis" creates some confusion about whether this is a descriptive or normative concept. The core distinction is clear but could be more precisely articulated.

source_grounding — 5.0 / 5.0

The entity is directly grounded in Smith's text with an exact quotation provided, showing this is a concept Smith explicitly discusses rather than an interpretive overlay. The distinction between prime cost and natural price appears to be authentic to the source.

domain_placement — 4.0 / 5.0

"Production" is an appropriate domain since prime cost relates to manufacturing/creation costs, though it could arguably fit in a "Pricing" or "Cost Structure" domain since it's fundamentally about how different cost components relate to final prices. The placement is reasonable but not uniquely correct.

vsm_relevance — 4.0 / 5.0

This maps well to S1 (primary operations) as it concerns the fundamental cost structure of productive activities, and potentially to S3 (internal regulation) as it relates to cost accounting and control mechanisms. It has clear operational relevance rather than being abstractly theoretical.

explanatory_value — 4.0 / 5.0

This concept illuminates an important structural distinction in how costs accumulate through supply chains, helping explain why prices must exceed production costs to sustain commerce. It reveals a key mechanism in price formation rather than just labeling a surface phenomenon.

3.5 KiB Raw Blame History