Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

kitchen_garden

null

2026-02-23T05:39:20.428965

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes kitchen gardens from other agricultural land uses by their specific purpose (household consumption), cultivation intensity, and economic characteristics (higher rents per unit area). It avoids circularity and captures a distinct economic concept with measurable attributes.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion in Book I, Chapter 11, where he uses kitchen gardens as a specific example to illustrate principles of rent, intensive cultivation, and the relationship between land value and proximity to markets. The context accurately reflects Smith's economic analysis.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is correct, as kitchen gardens represent a specific mode of agricultural production with distinct economic characteristics. This placement appropriately categorizes it within the broader framework of productive economic activities.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Kitchen gardens map most naturally to S1 (primary operations) as a specific production activity, but the entity lacks clear connections to coordination, regulation, or intelligence functions. While it represents an operational unit, it doesn't illuminate broader systemic relationships within the VSM framework.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illustrating the economic mechanism linking land use intensity, proximity to markets, and rental values. It demonstrates how specific production choices respond to market conditions and spatial economics, making abstract principles concrete.

Evaluation: Kitchen Garden

definition_precision — 4.0 / 5.0

The definition clearly distinguishes kitchen gardens from other agricultural land uses by their specific purpose (household consumption), cultivation intensity, and economic characteristics (higher rents per unit area). It avoids circularity and captures a distinct economic concept with measurable attributes.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion in Book I, Chapter 11, where he uses kitchen gardens as a specific example to illustrate principles of rent, intensive cultivation, and the relationship between land value and proximity to markets. The context accurately reflects Smith's economic analysis.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is correct, as kitchen gardens represent a specific mode of agricultural production with distinct economic characteristics. This placement appropriately categorizes it within the broader framework of productive economic activities.

vsm_relevance — 3.0 / 5.0

Kitchen gardens map most naturally to S1 (primary operations) as a specific production activity, but the entity lacks clear connections to coordination, regulation, or intelligence functions. While it represents an operational unit, it doesn't illuminate broader systemic relationships within the VSM framework.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illustrating the economic mechanism linking land use intensity, proximity to markets, and rental values. It demonstrates how specific production choices respond to market conditions and spatial economics, making abstract principles concrete.

3.6 KiB Raw Blame History