Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

gross_revenue

null

2026-02-23T05:33:53.142691

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes gross revenue from net revenue by specifying it's the total annual produce before deducting capital maintenance expenses. The analogy to gross rent of a private estate provides additional conceptual clarity.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text from Book II, Chapter 2, where he explicitly discusses the distinction between gross and neat revenue using the private estate analogy. The definition accurately reflects Smith's original formulation.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placement in "Distribution" is appropriate since gross revenue relates to how the total produce is allocated between capital maintenance and available wealth for consumption. It could arguably fit in "Production" as well, but Distribution captures its role in the flow of economic value.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S3 (internal regulation/audit) as it represents a key metric for understanding total system output before accounting for maintenance costs. It's less directly operational than S1-focused concepts but more concrete than pure S5 policy abstractions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The concept provides significant explanatory power by establishing the foundational distinction between total production and available wealth, which is crucial for understanding how societies must allocate resources between capital maintenance and consumption. This illuminates a key structural relationship in economic systems.

Evaluation: Gross Revenue

definition_precision — 4.0 / 5.0

The definition clearly distinguishes gross revenue from net revenue by specifying it's the total annual produce before deducting capital maintenance expenses. The analogy to gross rent of a private estate provides additional conceptual clarity.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text from Book II, Chapter 2, where he explicitly discusses the distinction between gross and neat revenue using the private estate analogy. The definition accurately reflects Smith's original formulation.

domain_placement — 4.0 / 5.0

Placement in "Distribution" is appropriate since gross revenue relates to how the total produce is allocated between capital maintenance and available wealth for consumption. It could arguably fit in "Production" as well, but Distribution captures its role in the flow of economic value.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S3 (internal regulation/audit) as it represents a key metric for understanding total system output before accounting for maintenance costs. It's less directly operational than S1-focused concepts but more concrete than pure S5 policy abstractions.

explanatory_value — 4.0 / 5.0

The concept provides significant explanatory power by establishing the foundational distinction between total production and available wealth, which is crucial for understanding how societies must allocate resources between capital maintenance and consumption. This illuminates a key structural relationship in economic systems.

3.5 KiB Raw Blame History