Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

fruit_wall

null

2026-02-23T05:32:26.449205

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, describing a concrete physical structure with a defined purpose (protecting fruit trees and creating microclimates). It avoids circularity and captures a distinct concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does discuss fruit-walls in Book I, Chapter 11 as examples of agricultural improvements that increase land value by enabling production of higher-value crops. The entity accurately reflects Smith's use of this example in his analysis of land improvements.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is exactly correct, as fruit-walls are a capital improvement that directly affects agricultural production capacity and output quality. This fits perfectly within Smith's discussion of productive investments.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Fruit-walls map reasonably well to S1 (primary operations) as they are operational infrastructure that directly supports production activities. However, the mapping is not particularly strong or illuminating for VSM analysis.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important mechanism in Smith's theory—how capital investments in agricultural infrastructure can increase land productivity and value by enabling cultivation of crops that wouldn't otherwise be viable. It demonstrates the relationship between investment, environmental modification, and economic returns.

Evaluation: Fruit Wall

definition_precision — 4.0 / 5.0

The definition is clear and specific, describing a concrete physical structure with a defined purpose (protecting fruit trees and creating microclimates). It avoids circularity and captures a distinct concept rather than a vague umbrella term.

source_grounding — 4.0 / 5.0

Smith does discuss fruit-walls in Book I, Chapter 11 as examples of agricultural improvements that increase land value by enabling production of higher-value crops. The entity accurately reflects Smith's use of this example in his analysis of land improvements.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is exactly correct, as fruit-walls are a capital improvement that directly affects agricultural production capacity and output quality. This fits perfectly within Smith's discussion of productive investments.

vsm_relevance — 3.0 / 5.0

Fruit-walls map reasonably well to S1 (primary operations) as they are operational infrastructure that directly supports production activities. However, the mapping is not particularly strong or illuminating for VSM analysis.

explanatory_value — 4.0 / 5.0

This entity illuminates an important mechanism in Smith's theory—how capital investments in agricultural infrastructure can increase land productivity and value by enabling cultivation of crops that wouldn't otherwise be viable. It demonstrates the relationship between investment, environmental modification, and economic returns.

3.3 KiB Raw Blame History