Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

hop_garden

null

2026-02-23T05:35:10.972122

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and specific, identifying hop gardens as specialized agricultural land for hop cultivation used in beer production. It avoids circularity and distinguishes this from general agricultural land through its specialized nature and higher rent potential.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text from Book I, Chapter 11, where he specifically discusses hop gardens as examples of specialized agricultural production that command higher rents due to their intensive cultivation requirements and valuable output.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate, as hop gardens represent a specific form of agricultural production with distinct economic characteristics. This fits naturally within Smith's analysis of different types of productive activities and their economic returns.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Hop gardens map most naturally to S1 (primary operations) as a specific productive activity, but the concept is relatively VSM-neutral. While it represents operational production, it doesn't strongly illuminate coordination, regulation, intelligence, or policy functions within an economic system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides good explanatory value by illustrating Smith's broader principle that specialized, intensive agricultural production can command higher rents and returns than general farming. It demonstrates the economic mechanism linking specialization, investment intensity, and rental returns in agricultural markets.

Evaluation: Hop Garden

definition_precision — 4.0 / 5.0

The definition is clear and specific, identifying hop gardens as specialized agricultural land for hop cultivation used in beer production. It avoids circularity and distinguishes this from general agricultural land through its specialized nature and higher rent potential.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text from Book I, Chapter 11, where he specifically discusses hop gardens as examples of specialized agricultural production that command higher rents due to their intensive cultivation requirements and valuable output.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate, as hop gardens represent a specific form of agricultural production with distinct economic characteristics. This fits naturally within Smith's analysis of different types of productive activities and their economic returns.

vsm_relevance — 3.0 / 5.0

Hop gardens map most naturally to S1 (primary operations) as a specific productive activity, but the concept is relatively VSM-neutral. While it represents operational production, it doesn't strongly illuminate coordination, regulation, intelligence, or policy functions within an economic system.

explanatory_value — 4.0 / 5.0

This entity provides good explanatory value by illustrating Smith's broader principle that specialized, intensive agricultural production can command higher rents and returns than general farming. It demonstrates the economic mechanism linking specialization, investment intensity, and rental returns in agricultural markets.

3.5 KiB Raw Blame History