Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

nominal_price

null

2026-02-23T06:02:27.687521

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes nominal price from real value/purchasing power, capturing the key concept that money prices can fluctuate independently of underlying value. The definition is precise and non-circular, though it could be slightly more specific about what drives these independent fluctuations.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is thoroughly grounded in Smith's text, particularly in his analysis of bounties in Book IV, Chapter 5, where he explicitly distinguishes between nominal and real prices. Smith uses this distinction as a central analytical tool throughout his discussion of how bounties affect different types of prices.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since nominal price is fundamentally about how commodities are valued and traded in monetary terms. This concept sits at the heart of exchange relationships and price formation mechanisms.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Nominal price has moderate VSM relevance, primarily relating to S4 (intelligence) as it represents information about market conditions and environmental signals. However, it's somewhat abstract as a pure measurement concept rather than an active system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory power by enabling analysis of how monetary policy, currency fluctuations, and market interventions (like bounties) can create divergences between apparent and real value. It illuminates important mechanisms in Smith's critique of mercantile policies.

Evaluation: Nominal Price

definition_precision — 4.0 / 5.0

The definition clearly distinguishes nominal price from real value/purchasing power, capturing the key concept that money prices can fluctuate independently of underlying value. The definition is precise and non-circular, though it could be slightly more specific about what drives these independent fluctuations.

source_grounding — 5.0 / 5.0

This concept is thoroughly grounded in Smith's text, particularly in his analysis of bounties in Book IV, Chapter 5, where he explicitly distinguishes between nominal and real prices. Smith uses this distinction as a central analytical tool throughout his discussion of how bounties affect different types of prices.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since nominal price is fundamentally about how commodities are valued and traded in monetary terms. This concept sits at the heart of exchange relationships and price formation mechanisms.

vsm_relevance — 3.0 / 5.0

Nominal price has moderate VSM relevance, primarily relating to S4 (intelligence) as it represents information about market conditions and environmental signals. However, it's somewhat abstract as a pure measurement concept rather than an active system component.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory power by enabling analysis of how monetary policy, currency fluctuations, and market interventions (like bounties) can create divergences between apparent and real value. It illuminates important mechanisms in Smith's critique of mercantile policies.

3.5 KiB Raw Blame History