feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: prime_cost_of_commodities
evaluator: null
evaluated_at: '2026-02-23T06:08:39.056897'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a distinct concept - production cost excluding
reseller profit - but the second clause about "economic analysis" creates some
confusion about whether this is a descriptive or normative concept. The core distinction
is clear but could be more precisely articulated.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: The entity is directly grounded in Smith's text with an exact quotation
provided, showing this is a concept Smith explicitly discusses rather than an
interpretive overlay. The distinction between prime cost and natural price appears
to be authentic to the source.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"Production" is an appropriate domain since prime cost relates to manufacturing/creation
costs, though it could arguably fit in a "Pricing" or "Cost Structure" domain
since it''s fundamentally about how different cost components relate to final
prices. The placement is reasonable but not uniquely correct.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This maps well to S1 (primary operations) as it concerns the fundamental
cost structure of productive activities, and potentially to S3 (internal regulation)
as it relates to cost accounting and control mechanisms. It has clear operational
relevance rather than being abstractly theoretical.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This concept illuminates an important structural distinction in how costs
accumulate through supply chains, helping explain why prices must exceed production
costs to sustain commerce. It reveals a key mechanism in price formation rather
than just labeling a surface phenomenon.
---
# Evaluation: Prime Cost Of Commodities
## definition_precision — 3.0 / 5.0
The definition captures a distinct concept - production cost excluding reseller profit - but the second clause about "economic analysis" creates some confusion about whether this is a descriptive or normative concept. The core distinction is clear but could be more precisely articulated.
## source_grounding — 5.0 / 5.0
The entity is directly grounded in Smith's text with an exact quotation provided, showing this is a concept Smith explicitly discusses rather than an interpretive overlay. The distinction between prime cost and natural price appears to be authentic to the source.
## domain_placement — 4.0 / 5.0
"Production" is an appropriate domain since prime cost relates to manufacturing/creation costs, though it could arguably fit in a "Pricing" or "Cost Structure" domain since it's fundamentally about how different cost components relate to final prices. The placement is reasonable but not uniquely correct.
## vsm_relevance — 4.0 / 5.0
This maps well to S1 (primary operations) as it concerns the fundamental cost structure of productive activities, and potentially to S3 (internal regulation) as it relates to cost accounting and control mechanisms. It has clear operational relevance rather than being abstractly theoretical.
## explanatory_value — 4.0 / 5.0
This concept illuminates an important structural distinction in how costs accumulate through supply chains, helping explain why prices must exceed production costs to sustain commerce. It reveals a key mechanism in price formation rather than just labeling a surface phenomenon.