Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

vineyard

null

2026-02-23T06:37:36.782263

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and precise, identifying vineyards as land specifically for grape cultivation with the key economic characteristic of commanding premium rents due to wine's high value and geographical limitations. It avoids circularity and captures a distinct economic concept rather than being vague.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual text from Book I, Chapter 11, where he specifically discusses vineyards as examples of land commanding high rents due to produce value and limited suitable geography. The connection to corn production profitability regulation is also textually accurate.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate since vineyards represent a specific form of agricultural production with distinct economic characteristics. This fits naturally within Smith's analysis of different types of productive land use.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Vineyards map most naturally to S1 (primary operations) as a specific production unit, but the entity doesn't strongly illuminate VSM dynamics or relationships between systems. It's more of a production example than a systemic concept.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides good explanatory value by illustrating Smith's principles about how land rents are determined by produce value and scarcity of suitable land. It demonstrates the economic mechanism of differential rent based on product quality and geographical constraints.

Evaluation: Vineyard

definition_precision — 4.0 / 5.0

The definition is clear and precise, identifying vineyards as land specifically for grape cultivation with the key economic characteristic of commanding premium rents due to wine's high value and geographical limitations. It avoids circularity and captures a distinct economic concept rather than being vague.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual text from Book I, Chapter 11, where he specifically discusses vineyards as examples of land commanding high rents due to produce value and limited suitable geography. The connection to corn production profitability regulation is also textually accurate.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate since vineyards represent a specific form of agricultural production with distinct economic characteristics. This fits naturally within Smith's analysis of different types of productive land use.

vsm_relevance — 3.0 / 5.0

Vineyards map most naturally to S1 (primary operations) as a specific production unit, but the entity doesn't strongly illuminate VSM dynamics or relationships between systems. It's more of a production example than a systemic concept.

explanatory_value — 4.0 / 5.0

The entity provides good explanatory value by illustrating Smith's principles about how land rents are determined by produce value and scarcity of suitable land. It demonstrates the economic mechanism of differential rent based on product quality and geographical constraints.

3.4 KiB Raw Blame History