Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

pasture_land

null

2026-02-23T06:04:45.190842

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying pasture land as land used for grazing livestock with rent determined by animal capacity and livestock product value. It avoids circularity and captures a distinct economic concept within Smith's agricultural analysis.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book I, Chapter 11, where Smith extensively analyzes different types of land use, including pasture land, and discusses how their rents are determined by productivity and market conditions. The concept is central to his discussion of agricultural economics.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as pasture land is a fundamental factor of production in Smith's analysis of agricultural output. It fits naturally within the broader category of land as a productive resource.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Pasture land maps most naturally to S1 (primary operations) as a basic productive resource, but it's somewhat static as a concept and doesn't strongly engage with the dynamic regulatory or adaptive aspects that make VSM mapping particularly illuminating. It's more of a foundational input than a system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory value by illuminating how different land uses compete economically and how rent mechanisms work across agricultural sectors. It helps explain the structural relationships between land productivity, market prices, and resource allocation decisions.

Evaluation: Pasture Land

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying pasture land as land used for grazing livestock with rent determined by animal capacity and livestock product value. It avoids circularity and captures a distinct economic concept within Smith's agricultural analysis.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book I, Chapter 11, where Smith extensively analyzes different types of land use, including pasture land, and discusses how their rents are determined by productivity and market conditions. The concept is central to his discussion of agricultural economics.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as pasture land is a fundamental factor of production in Smith's analysis of agricultural output. It fits naturally within the broader category of land as a productive resource.

vsm_relevance — 3.0 / 5.0

Pasture land maps most naturally to S1 (primary operations) as a basic productive resource, but it's somewhat static as a concept and doesn't strongly engage with the dynamic regulatory or adaptive aspects that make VSM mapping particularly illuminating. It's more of a foundational input than a system component.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory value by illuminating how different land uses compete economically and how rent mechanisms work across agricultural sectors. It helps explain the structural relationships between land productivity, market prices, and resource allocation decisions.

3.5 KiB Raw Blame History