Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

real_price

null

2026-02-23T06:16:00.798232

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes real price from nominal price by anchoring it to labor command and subsistence provision, creating a precise conceptual boundary. The definition avoids circularity and captures Smith's specific technical meaning rather than colloquial usage.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is deeply rooted in Smith's actual text, particularly his labor theory of value and his distinction between real and nominal prices throughout The Wealth of Nations. The entity accurately reflects Smith's own terminology and theoretical framework without imposing modern interpretations.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Exchange" domain is precisely correct, as real price is fundamentally about how commodities exchange against labor and subsistence rather than against money. This concept sits at the heart of Smith's exchange theory and value measurement.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Real price functions primarily as an S4 (intelligence) concept, providing environmental scanning capability to distinguish true economic signals from monetary noise. However, it also serves S3 (audit) functions by enabling assessment of actual versus apparent value, giving it moderate VSM relevance.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial mechanism in Smith's economic system—how to measure true economic value independent of monetary fluctuations. It provides essential analytical power for understanding Smith's critique of mercantilism and his theory of wealth creation.

Evaluation: Real Price

definition_precision — 4.0 / 5.0

The definition clearly distinguishes real price from nominal price by anchoring it to labor command and subsistence provision, creating a precise conceptual boundary. The definition avoids circularity and captures Smith's specific technical meaning rather than colloquial usage.

source_grounding — 5.0 / 5.0

This concept is deeply rooted in Smith's actual text, particularly his labor theory of value and his distinction between real and nominal prices throughout The Wealth of Nations. The entity accurately reflects Smith's own terminology and theoretical framework without imposing modern interpretations.

domain_placement — 5.0 / 5.0

Placement in the "Exchange" domain is precisely correct, as real price is fundamentally about how commodities exchange against labor and subsistence rather than against money. This concept sits at the heart of Smith's exchange theory and value measurement.

vsm_relevance — 3.0 / 5.0

Real price functions primarily as an S4 (intelligence) concept, providing environmental scanning capability to distinguish true economic signals from monetary noise. However, it also serves S3 (audit) functions by enabling assessment of actual versus apparent value, giving it moderate VSM relevance.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial mechanism in Smith's economic system—how to measure true economic value independent of monetary fluctuations. It provides essential analytical power for understanding Smith's critique of mercantilism and his theory of wealth creation.

3.5 KiB Raw Blame History