Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_productivity

null

2026-02-23T00:31:03.242713

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes agricultural productivity as efficiency of output per unit of land/labor, with specific measurement criteria. It avoids circularity and captures a distinct economic concept, though it could be slightly more precise about what constitutes "efficiency."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Book I, Chapter 11, where Smith extensively discusses agricultural improvements, their effects on land rents, and the relationship between agricultural productivity and food costs. The connection to land rents and economic development directly reflects Smith's analysis.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain assignment, as agricultural productivity fundamentally concerns the efficiency of productive processes in agriculture. This aligns perfectly with Smith's treatment of it as a production-side factor affecting rents and costs.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Agricultural productivity maps primarily to S1 (primary operations) as a core productive activity, with some relevance to S4 (adaptation through technological improvements). However, it's somewhat abstract as a measure of efficiency rather than a concrete operational or regulatory mechanism.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides strong explanatory power by illuminating the causal mechanism between agricultural improvements, land rents, food costs, and broader economic development. It captures a key structural relationship in Smith's economic theory rather than just naming a surface phenomenon.

Evaluation: Agricultural Productivity

definition_precision — 4.0 / 5.0

The definition clearly distinguishes agricultural productivity as efficiency of output per unit of land/labor, with specific measurement criteria. It avoids circularity and captures a distinct economic concept, though it could be slightly more precise about what constitutes "efficiency."

source_grounding — 5.0 / 5.0

This entity is well-grounded in Book I, Chapter 11, where Smith extensively discusses agricultural improvements, their effects on land rents, and the relationship between agricultural productivity and food costs. The connection to land rents and economic development directly reflects Smith's analysis.

domain_placement — 5.0 / 5.0

"Production" is the correct domain assignment, as agricultural productivity fundamentally concerns the efficiency of productive processes in agriculture. This aligns perfectly with Smith's treatment of it as a production-side factor affecting rents and costs.

vsm_relevance — 3.0 / 5.0

Agricultural productivity maps primarily to S1 (primary operations) as a core productive activity, with some relevance to S4 (adaptation through technological improvements). However, it's somewhat abstract as a measure of efficiency rather than a concrete operational or regulatory mechanism.

explanatory_value — 5.0 / 5.0

This entity provides strong explanatory power by illuminating the causal mechanism between agricultural improvements, land rents, food costs, and broader economic development. It captures a key structural relationship in Smith's economic theory rather than just naming a surface phenomenon.

3.5 KiB Raw Blame History