Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

price_in_money

null

2026-02-23T06:08:20.962068

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes price in money from price in labour terms, establishing it as the conventional market measurement denominated in currency. It's precise and non-circular, though it could be slightly more specific about what "quantity of money it commands" means in practice.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Book I, Chapter 5 of The Wealth of Nations, where Smith explicitly contrasts money price with real price (labour). The entity accurately reflects Smith's discussion of money as a conventional measure of value.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this concept deals with how commodities are valued and traded in markets. Price in money is fundamentally about the exchange mechanism and market transactions.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it represents the basic transactional mechanism of the economic system. It could also relate to S2 for coordination through price signals, but it's not as structurally rich as other VSM-relevant concepts.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides good explanatory value by illuminating how markets actually function through monetary pricing rather than theoretical labour measures. It helps explain the practical mechanism of exchange, though it's more descriptive of market phenomena than revelatory of deep structural relations.

Evaluation: Price In Money

definition_precision — 4.0 / 5.0

The definition clearly distinguishes price in money from price in labour terms, establishing it as the conventional market measurement denominated in currency. It's precise and non-circular, though it could be slightly more specific about what "quantity of money it commands" means in practice.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Book I, Chapter 5 of The Wealth of Nations, where Smith explicitly contrasts money price with real price (labour). The entity accurately reflects Smith's discussion of money as a conventional measure of value.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this concept deals with how commodities are valued and traded in markets. Price in money is fundamentally about the exchange mechanism and market transactions.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as it represents the basic transactional mechanism of the economic system. It could also relate to S2 for coordination through price signals, but it's not as structurally rich as other VSM-relevant concepts.

explanatory_value — 4.0 / 5.0

The entity provides good explanatory value by illuminating how markets actually function through monetary pricing rather than theoretical labour measures. It helps explain the practical mechanism of exchange, though it's more descriptive of market phenomena than revelatory of deep structural relations.

3.4 KiB Raw Blame History