Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

immediate_consumption

null

2026-02-23T05:35:53.194062

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying immediate consumption as stock reserved for present use rather than revenue generation, with concrete examples (food, clothing, furniture, dwellings). The distinction between consumption function versus revenue production provides a precise conceptual boundary.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text from Book II, Chapter 1, where he explicitly distinguishes between the portion of stock reserved for immediate consumption versus that employed as capital. The examples given (food, clothing, household furniture, dwelling houses) align closely with Smith's own categorization.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Consumption" domain assignment is perfectly appropriate, as this entity specifically concerns how individuals allocate their stock for immediate use rather than productive investment. This represents a fundamental consumption category in Smith's economic framework.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, most naturally mapping to S1 (primary operations) as it represents the basic subsistence requirements that enable economic actors to function. However, it's somewhat abstract as a pure consumption category rather than an active system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating the fundamental distinction between wealth used for subsistence versus accumulation, which is crucial for understanding Smith's theory of capital formation. It reveals the structural relationship between consumption and investment decisions in economic behavior.

Evaluation: Immediate Consumption

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying immediate consumption as stock reserved for present use rather than revenue generation, with concrete examples (food, clothing, furniture, dwellings). The distinction between consumption function versus revenue production provides a precise conceptual boundary.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text from Book II, Chapter 1, where he explicitly distinguishes between the portion of stock reserved for immediate consumption versus that employed as capital. The examples given (food, clothing, household furniture, dwelling houses) align closely with Smith's own categorization.

domain_placement — 5.0 / 5.0

The "Consumption" domain assignment is perfectly appropriate, as this entity specifically concerns how individuals allocate their stock for immediate use rather than productive investment. This represents a fundamental consumption category in Smith's economic framework.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, most naturally mapping to S1 (primary operations) as it represents the basic subsistence requirements that enable economic actors to function. However, it's somewhat abstract as a pure consumption category rather than an active system component.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating the fundamental distinction between wealth used for subsistence versus accumulation, which is crucial for understanding Smith's theory of capital formation. It reveals the structural relationship between consumption and investment decisions in economic behavior.

3.7 KiB Raw Blame History