Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_trade

null

2026-02-23T00:32:37.131022

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes agricultural trade from general trade by specifying the exchange of agricultural products and identifying key enabling factors (transportation, market institutions). It avoids circularity and captures a distinct economic phenomenon with specific characteristics.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis in Book I, Chapter 11, where he extensively discusses how agricultural products move between regions and how this trade affects domestic markets, land rents, and economic development. The concept directly reflects Smith's examination of agricultural commerce.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is the correct placement for agricultural trade, as it fundamentally concerns the movement and exchange of goods between different economic actors and regions. This is a core exchange mechanism rather than production, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Agricultural trade maps well to S1 (primary operations of exchanging goods) and S4 (intelligence about external markets and opportunities for specialization). The concept has clear operational and adaptive intelligence components within the VSM framework.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates important mechanisms of regional specialization, comparative advantage, and market integration that Smith analyzes. It explains how transportation and market institutions enable economic efficiency rather than merely naming a surface activity.

Evaluation: Agricultural Trade

definition_precision — 4.0 / 5.0

The definition clearly distinguishes agricultural trade from general trade by specifying the exchange of agricultural products and identifying key enabling factors (transportation, market institutions). It avoids circularity and captures a distinct economic phenomenon with specific characteristics.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book I, Chapter 11, where he extensively discusses how agricultural products move between regions and how this trade affects domestic markets, land rents, and economic development. The concept directly reflects Smith's examination of agricultural commerce.

domain_placement — 5.0 / 5.0

The "Exchange" domain is the correct placement for agricultural trade, as it fundamentally concerns the movement and exchange of goods between different economic actors and regions. This is a core exchange mechanism rather than production, distribution, or consumption.

vsm_relevance — 4.0 / 5.0

Agricultural trade maps well to S1 (primary operations of exchanging goods) and S4 (intelligence about external markets and opportunities for specialization). The concept has clear operational and adaptive intelligence components within the VSM framework.

explanatory_value — 4.0 / 5.0

This entity illuminates important mechanisms of regional specialization, comparative advantage, and market integration that Smith analyzes. It explains how transportation and market institutions enable economic efficiency rather than merely naming a surface activity.

3.5 KiB Raw Blame History