Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_development_sequence

null

2026-02-23T00:26:36.595549

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly outlines a specific historical progression through distinct stages (subsistence → servile → metayer → yeoman farming) with identifiable characteristics at each stage. While comprehensive, it could be slightly more precise about what constitutes "increasing economic efficiency" in measurable terms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book III, Chapter 2 of The Wealth of Nations, where Smith explicitly traces this agricultural development sequence and argues for the superior efficiency of independent yeoman farming. The progression described matches Smith's historical analysis of agricultural systems.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this represents Smith's broader theoretical framework about economic development and institutional evolution. This is a foundational theoretical concept rather than a specific policy mechanism or market operation.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how agricultural systems adapt and evolve in response to changing legal, social, and economic environments. It also has some S5 relevance regarding the identity and policy frameworks that enable different agricultural arrangements.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanisms behind agricultural productivity improvements and showing how institutional changes drive economic development. It explains why some regions advanced economically while others remained stagnant, making it a key analytical framework in Smith's theory.

Evaluation: Agricultural Development Sequence

definition_precision — 4.0 / 5.0

The definition clearly outlines a specific historical progression through distinct stages (subsistence → servile → metayer → yeoman farming) with identifiable characteristics at each stage. While comprehensive, it could be slightly more precise about what constitutes "increasing economic efficiency" in measurable terms.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book III, Chapter 2 of The Wealth of Nations, where Smith explicitly traces this agricultural development sequence and argues for the superior efficiency of independent yeoman farming. The progression described matches Smith's historical analysis of agricultural systems.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this represents Smith's broader theoretical framework about economic development and institutional evolution. This is a foundational theoretical concept rather than a specific policy mechanism or market operation.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how agricultural systems adapt and evolve in response to changing legal, social, and economic environments. It also has some S5 relevance regarding the identity and policy frameworks that enable different agricultural arrangements.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanisms behind agricultural productivity improvements and showing how institutional changes drive economic development. It explains why some regions advanced economically while others remained stagnant, making it a key analytical framework in Smith's theory.

3.8 KiB Raw Blame History