Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

revenue

null

2026-02-23T06:19:08.902783

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes revenue as income from capital stock, specifying both circulating goods and fixed capital sources. It avoids circularity by grounding the concept in the employment of stock as capital rather than simply defining revenue as "income."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book II, Chapter 1 of The Wealth of Nations, where Smith explicitly discusses the distinction between stock reserved for consumption and stock employed as capital to generate revenue. The definition accurately reflects Smith's conceptual framework.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placement in "Distribution" is appropriate since revenue represents how returns from capital are allocated and distributed within the economic system. However, it could arguably also fit in a "Production" domain given its connection to productive capital employment.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Revenue maps most naturally to S1 (primary operations) as it represents the direct output/return from productive activities, but it also has relevance to S3 (internal regulation) for monitoring capital performance. The mapping is reasonable but not uniquely clear to one system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the mechanism through which capital generates returns and sustains economic activity. It helps explain the structural relationship between capital employment and wealth accumulation rather than merely naming a surface phenomenon.

Evaluation: Revenue

definition_precision — 4.0 / 5.0

The definition clearly distinguishes revenue as income from capital stock, specifying both circulating goods and fixed capital sources. It avoids circularity by grounding the concept in the employment of stock as capital rather than simply defining revenue as "income."

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book II, Chapter 1 of The Wealth of Nations, where Smith explicitly discusses the distinction between stock reserved for consumption and stock employed as capital to generate revenue. The definition accurately reflects Smith's conceptual framework.

domain_placement — 4.0 / 5.0

Placement in "Distribution" is appropriate since revenue represents how returns from capital are allocated and distributed within the economic system. However, it could arguably also fit in a "Production" domain given its connection to productive capital employment.

vsm_relevance — 3.0 / 5.0

Revenue maps most naturally to S1 (primary operations) as it represents the direct output/return from productive activities, but it also has relevance to S3 (internal regulation) for monitoring capital performance. The mapping is reasonable but not uniquely clear to one system.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the mechanism through which capital generates returns and sustains economic activity. It helps explain the structural relationship between capital employment and wealth accumulation rather than merely naming a surface phenomenon.

3.4 KiB Raw Blame History