feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,62 @@
---
entity_slug: real_price_of_commodities
evaluator: null
evaluated_at: '2026-02-23T06:15:51.241869'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes real price from nominal price and
identifies labour quantity as the key measure. It's precise in capturing the "toil
and trouble" concept, though could be slightly more specific about how labour
quantity is determined.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly and extensively grounded in Book I, Chapter
5, where Smith explicitly develops the labour theory of value and the real vs.
nominal price distinction. The "toil and trouble" language directly reflects Smith's
own terminology.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Exchange" is the correct domain placement as this concept is fundamental
to Smith''s theory of how goods are valued and exchanged in markets. It sits at
the core of his exchange value framework.'
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This is primarily a theoretical measurement concept rather than an operational
system component. While it might inform S4 (intelligence) functions in understanding
true economic costs, it doesn't naturally map to any specific VSM system.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides crucial explanatory power by revealing the underlying
mechanism of value determination beyond surface monetary prices. It illuminates
how Smith distinguishes between appearance (money price) and reality (labour cost)
in economic exchange.
---
# Evaluation: Real Price Of Commodities
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes real price from nominal price and identifies labour quantity as the key measure. It's precise in capturing the "toil and trouble" concept, though could be slightly more specific about how labour quantity is determined.
## source_grounding — 5.0 / 5.0
This concept is directly and extensively grounded in Book I, Chapter 5, where Smith explicitly develops the labour theory of value and the real vs. nominal price distinction. The "toil and trouble" language directly reflects Smith's own terminology.
## domain_placement — 5.0 / 5.0
"Exchange" is the correct domain placement as this concept is fundamental to Smith's theory of how goods are valued and exchanged in markets. It sits at the core of his exchange value framework.
## vsm_relevance — 2.0 / 5.0
This is primarily a theoretical measurement concept rather than an operational system component. While it might inform S4 (intelligence) functions in understanding true economic costs, it doesn't naturally map to any specific VSM system.
## explanatory_value — 5.0 / 5.0
This entity provides crucial explanatory power by revealing the underlying mechanism of value determination beyond surface monetary prices. It illuminates how Smith distinguishes between appearance (money price) and reality (labour cost) in economic exchange.