Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

natural_produce_of_land

null

2026-02-23T06:00:40.276143

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes natural produce from cultivated goods and specifies concrete examples (wood, grass). It precisely captures the concept of resources requiring only gathering labor rather than productive cultivation.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's discussion in Book I, Chapter 6, where he explicitly uses examples like wood and grass to explain how rent emerges when land becomes private property. The entity accurately reflects Smith's actual text and reasoning.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Production" is appropriate since this concerns what land naturally yields, though it sits at the boundary between production and distribution (given its role in rent theory). The placement captures the primary economic function while acknowledging its distributional implications.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps reasonably well to S1 (primary operations) as it represents basic resource inputs to economic activity. However, it's somewhat static as a resource category rather than representing dynamic systemic processes that VSM typically addresses.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power for understanding Smith's rent theory and the transition from common to private property. It illuminates the mechanism by which previously free resources become subject to rent, revealing a fundamental structural change in economic relations.

Evaluation: Natural Produce Of Land

definition_precision — 4.0 / 5.0

The definition clearly distinguishes natural produce from cultivated goods and specifies concrete examples (wood, grass). It precisely captures the concept of resources requiring only gathering labor rather than productive cultivation.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's discussion in Book I, Chapter 6, where he explicitly uses examples like wood and grass to explain how rent emerges when land becomes private property. The entity accurately reflects Smith's actual text and reasoning.

domain_placement — 4.0 / 5.0

"Production" is appropriate since this concerns what land naturally yields, though it sits at the boundary between production and distribution (given its role in rent theory). The placement captures the primary economic function while acknowledging its distributional implications.

vsm_relevance — 3.0 / 5.0

This entity maps reasonably well to S1 (primary operations) as it represents basic resource inputs to economic activity. However, it's somewhat static as a resource category rather than representing dynamic systemic processes that VSM typically addresses.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power for understanding Smith's rent theory and the transition from common to private property. It illuminates the mechanism by which previously free resources become subject to rent, revealing a fundamental structural change in economic relations.

3.3 KiB Raw Blame History