Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

importation_trade

null

2026-02-23T05:36:07.711832

3.8

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct economic activity but lacks precision in key areas. The phrase "occasionally liberalized during periods of scarcity" is vague and doesn't clearly distinguish importation trade from general foreign trade or specify what makes it a unique concept.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual discussion in Book IV, Chapter 5, where he explicitly examines importation trade, its restrictions, and its role during scarcity. The context accurately reflects Smith's comparative analysis of inland versus foreign trade importance.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for importation trade, as it fundamentally involves the exchange of goods across national boundaries. This is a core exchange mechanism that Smith analyzes extensively.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Importation trade maps naturally to S4 (intelligence/environmental adaptation) as it represents how an economic system adapts to external opportunities and domestic scarcities. It also has S1 relevance as a primary operational activity for meeting market demands.

name	value	max_value	rationale
explanatory_value	3.0	5.0	While the entity identifies an important economic mechanism, it provides limited explanatory power beyond naming the activity. It doesn't illuminate the deeper structural relations or mechanisms that Smith analyzes regarding how importation trade affects national wealth and market dynamics.

Evaluation: Importation Trade

definition_precision — 3.0 / 5.0

The definition captures a distinct economic activity but lacks precision in key areas. The phrase "occasionally liberalized during periods of scarcity" is vague and doesn't clearly distinguish importation trade from general foreign trade or specify what makes it a unique concept.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual discussion in Book IV, Chapter 5, where he explicitly examines importation trade, its restrictions, and its role during scarcity. The context accurately reflects Smith's comparative analysis of inland versus foreign trade importance.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for importation trade, as it fundamentally involves the exchange of goods across national boundaries. This is a core exchange mechanism that Smith analyzes extensively.

vsm_relevance — 4.0 / 5.0

Importation trade maps naturally to S4 (intelligence/environmental adaptation) as it represents how an economic system adapts to external opportunities and domestic scarcities. It also has S1 relevance as a primary operational activity for meeting market demands.

explanatory_value — 3.0 / 5.0

While the entity identifies an important economic mechanism, it provides limited explanatory power beyond naming the activity. It doesn't illuminate the deeper structural relations or mechanisms that Smith analyzes regarding how importation trade affects national wealth and market dynamics.

3.3 KiB Raw Blame History