Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_development_constraints

null

2026-02-23T00:26:27.254856

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific institutional barriers (primogeniture, entails, servile labor, etc.) and their collective effect on agricultural productivity. While comprehensive, it avoids being overly broad by focusing on concrete legal and social mechanisms rather than vague generalizations.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's detailed analysis in Book III, Chapter 2, where he systematically examines how various institutional arrangements discouraged agricultural improvement in medieval Europe. The specific constraints listed (primogeniture, entails, insecure tenure) are explicitly discussed by Smith as barriers to agricultural development.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Production" domain assignment is entirely appropriate since these constraints directly affected agricultural productivity and the organization of productive activities. Agricultural development is fundamentally about production systems and their efficiency.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity spans multiple VSM systems - S1 (affecting primary agricultural operations), S3 (regulatory/legal frameworks), and S4 (adaptation to environmental/market conditions) - making it somewhat diffuse from a VSM perspective. While relevant to organizational viability, it doesn't map cleanly to a single system function.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by identifying the structural mechanisms that prevented agricultural improvement, helping explain why European agriculture remained stagnant for centuries. It illuminates the causal relationship between institutional arrangements and economic development rather than merely describing surface phenomena.

Evaluation: Agricultural Development Constraints

definition_precision — 4.0 / 5.0

The definition clearly identifies specific institutional barriers (primogeniture, entails, servile labor, etc.) and their collective effect on agricultural productivity. While comprehensive, it avoids being overly broad by focusing on concrete legal and social mechanisms rather than vague generalizations.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's detailed analysis in Book III, Chapter 2, where he systematically examines how various institutional arrangements discouraged agricultural improvement in medieval Europe. The specific constraints listed (primogeniture, entails, insecure tenure) are explicitly discussed by Smith as barriers to agricultural development.

domain_placement — 5.0 / 5.0

The "Production" domain assignment is entirely appropriate since these constraints directly affected agricultural productivity and the organization of productive activities. Agricultural development is fundamentally about production systems and their efficiency.

vsm_relevance — 3.0 / 5.0

This entity spans multiple VSM systems - S1 (affecting primary agricultural operations), S3 (regulatory/legal frameworks), and S4 (adaptation to environmental/market conditions) - making it somewhat diffuse from a VSM perspective. While relevant to organizational viability, it doesn't map cleanly to a single system function.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by identifying the structural mechanisms that prevented agricultural improvement, helping explain why European agriculture remained stagnant for centuries. It illuminates the causal relationship between institutional arrangements and economic development rather than merely describing surface phenomena.

3.9 KiB Raw Blame History