Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

real_price_of_commodities

null

2026-02-23T06:15:51.241869

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes real price from nominal price and identifies labour quantity as the key measure. It's precise in capturing the "toil and trouble" concept, though could be slightly more specific about how labour quantity is determined.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly and extensively grounded in Book I, Chapter 5, where Smith explicitly develops the labour theory of value and the real vs. nominal price distinction. The "toil and trouble" language directly reflects Smith's own terminology.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement as this concept is fundamental to Smith's theory of how goods are valued and exchanged in markets. It sits at the core of his exchange value framework.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This is primarily a theoretical measurement concept rather than an operational system component. While it might inform S4 (intelligence) functions in understanding true economic costs, it doesn't naturally map to any specific VSM system.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power by revealing the underlying mechanism of value determination beyond surface monetary prices. It illuminates how Smith distinguishes between appearance (money price) and reality (labour cost) in economic exchange.

Evaluation: Real Price Of Commodities

definition_precision — 4.0 / 5.0

The definition clearly distinguishes real price from nominal price and identifies labour quantity as the key measure. It's precise in capturing the "toil and trouble" concept, though could be slightly more specific about how labour quantity is determined.

source_grounding — 5.0 / 5.0

This concept is directly and extensively grounded in Book I, Chapter 5, where Smith explicitly develops the labour theory of value and the real vs. nominal price distinction. The "toil and trouble" language directly reflects Smith's own terminology.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement as this concept is fundamental to Smith's theory of how goods are valued and exchanged in markets. It sits at the core of his exchange value framework.

vsm_relevance — 2.0 / 5.0

This is primarily a theoretical measurement concept rather than an operational system component. While it might inform S4 (intelligence) functions in understanding true economic costs, it doesn't naturally map to any specific VSM system.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power by revealing the underlying mechanism of value determination beyond surface monetary prices. It illuminates how Smith distinguishes between appearance (money price) and reality (labour cost) in economic exchange.

3.1 KiB Raw Blame History