Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

surplus_produce

null

2026-02-23T06:28:04.543443

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes surplus produce as production exceeding domestic consumption, with specific mention of its potential uses (capital accumulation, trade, export). The concept is well-bounded and avoids circularity, though it could be slightly more precise about the measurement threshold.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text, particularly in Book II Chapter 5 where he extensively discusses how surplus produce drives international trade and must find outlets beyond domestic markets. The entity accurately reflects Smith's actual arguments about surplus and exchange.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Production" is the correct domain placement since surplus produce is fundamentally about the output side of economic activity and the relationship between production capacity and consumption needs. This clearly belongs in production theory rather than exchange or distribution domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations producing the surplus) and S4 (intelligence about external markets and trade opportunities for surplus disposal). The concept bridges operational production with environmental adaptation, making it highly relevant to VSM thinking.

name	value	max_value	rationale
explanatory_value	5.0	5.0	Surplus produce illuminates a crucial structural mechanism in Smith's economics—how production beyond subsistence enables capital accumulation, international trade, and economic growth. It explains the fundamental driver of trade relationships and economic development beyond mere subsistence.

Evaluation: Surplus Produce

definition_precision — 4.0 / 5.0

The definition clearly distinguishes surplus produce as production exceeding domestic consumption, with specific mention of its potential uses (capital accumulation, trade, export). The concept is well-bounded and avoids circularity, though it could be slightly more precise about the measurement threshold.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text, particularly in Book II Chapter 5 where he extensively discusses how surplus produce drives international trade and must find outlets beyond domestic markets. The entity accurately reflects Smith's actual arguments about surplus and exchange.

domain_placement — 5.0 / 5.0

"Production" is the correct domain placement since surplus produce is fundamentally about the output side of economic activity and the relationship between production capacity and consumption needs. This clearly belongs in production theory rather than exchange or distribution domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations producing the surplus) and S4 (intelligence about external markets and trade opportunities for surplus disposal). The concept bridges operational production with environmental adaptation, making it highly relevant to VSM thinking.

explanatory_value — 5.0 / 5.0

Surplus produce illuminates a crucial structural mechanism in Smith's economics—how production beyond subsistence enables capital accumulation, international trade, and economic growth. It explains the fundamental driver of trade relationships and economic development beyond mere subsistence.

3.6 KiB Raw Blame History