Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

fruit_garden

null

2026-02-23T05:32:18.956674

3.8

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, distinguishing fruit gardens from general agriculture by their long-term investment nature and premium rent potential. It avoids circularity and captures the economic characteristics that make fruit gardens distinct from other agricultural land uses.

name	value	max_value	rationale
source_grounding	4.0	5.0	This appears well-grounded in Smith's discussion of agricultural rent variations in Book I, Chapter 11, where he examines how different types of land use command different rents based on their productivity and market value. The connection to specialized agricultural production and rent justification aligns with Smith's analytical framework.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain placement, as fruit gardens represent a specific form of agricultural production with distinct economic characteristics. This fits naturally within Smith's broader analysis of productive activities and land use economics.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Fruit gardens map most naturally to S1 (primary operations) as a specific production activity, but the concept is relatively VSM-neutral. While it represents operational production, it doesn't strongly illuminate coordination, regulation, adaptation, or policy functions within an economic system.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The entity provides moderate explanatory value by illustrating how specialized agricultural investments can command premium rents, contributing to understanding of land rent differentiation. However, it primarily exemplifies broader principles rather than revealing fundamental economic mechanisms or structural relations.

Evaluation: Fruit Garden

definition_precision — 4.0 / 5.0

The definition is clear and specific, distinguishing fruit gardens from general agriculture by their long-term investment nature and premium rent potential. It avoids circularity and captures the economic characteristics that make fruit gardens distinct from other agricultural land uses.

source_grounding — 4.0 / 5.0

This appears well-grounded in Smith's discussion of agricultural rent variations in Book I, Chapter 11, where he examines how different types of land use command different rents based on their productivity and market value. The connection to specialized agricultural production and rent justification aligns with Smith's analytical framework.

domain_placement — 5.0 / 5.0

"Production" is the correct domain placement, as fruit gardens represent a specific form of agricultural production with distinct economic characteristics. This fits naturally within Smith's broader analysis of productive activities and land use economics.

vsm_relevance — 3.0 / 5.0

Fruit gardens map most naturally to S1 (primary operations) as a specific production activity, but the concept is relatively VSM-neutral. While it represents operational production, it doesn't strongly illuminate coordination, regulation, adaptation, or policy functions within an economic system.

explanatory_value — 3.0 / 5.0

The entity provides moderate explanatory value by illustrating how specialized agricultural investments can command premium rents, contributing to understanding of land rent differentiation. However, it primarily exemplifies broader principles rather than revealing fundamental economic mechanisms or structural relations.

3.7 KiB Raw Blame History