Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

neat_revenue

null

2026-02-23T06:01:52.086227

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and precise, establishing neat revenue as the remainder after deducting capital maintenance costs from annual produce. The analogy to "neat rent" helps clarify the concept, though the term "free" could be slightly more precise.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text from Book II, Chapter 2, where he explicitly discusses the distinction between gross and neat revenue and their relationship to societal wealth. The definition accurately reflects Smith's original formulation.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Distribution" is appropriate since neat revenue concerns how society's total output is allocated between capital maintenance and available consumption. However, it could also fit in a "Capital" or "Wealth" domain given its focus on what remains after capital expenses.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S3 (internal regulation) as it represents a key performance metric for societal resource allocation. However, it's more of an outcome measure than an active system component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by distinguishing between gross output and actual available wealth, illuminating the crucial mechanism of how capital maintenance requirements affect societal prosperity. It reveals the structural relationship between production, capital, and consumable wealth.

Evaluation: Neat Revenue

definition_precision — 4.0 / 5.0

The definition is clear and precise, establishing neat revenue as the remainder after deducting capital maintenance costs from annual produce. The analogy to "neat rent" helps clarify the concept, though the term "free" could be slightly more precise.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text from Book II, Chapter 2, where he explicitly discusses the distinction between gross and neat revenue and their relationship to societal wealth. The definition accurately reflects Smith's original formulation.

domain_placement — 4.0 / 5.0

"Distribution" is appropriate since neat revenue concerns how society's total output is allocated between capital maintenance and available consumption. However, it could also fit in a "Capital" or "Wealth" domain given its focus on what remains after capital expenses.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S3 (internal regulation) as it represents a key performance metric for societal resource allocation. However, it's more of an outcome measure than an active system component.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by distinguishing between gross output and actual available wealth, illuminating the crucial mechanism of how capital maintenance requirements affect societal prosperity. It reveals the structural relationship between production, capital, and consumable wealth.

3.3 KiB Raw Blame History