Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

merchant_carrier

null

2026-02-23T05:51:24.235580

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct trading role - someone who imports goods specifically for re-export rather than domestic sale. This creates a clear conceptual boundary that distinguishes merchant-carriers from other types of traders.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book IV, Chapter 5, where he explicitly discusses this type of trader and their role in the corn trade. The concept emerges naturally from Smith's analysis of bounties and trade policies.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate, as merchant-carriers are fundamentally about facilitating trade flows and market connections between different countries. This is a core exchange mechanism rather than production, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S4 (intelligence/environmental adaptation) as merchant-carriers respond to price differentials and market opportunities across different national markets. They also contribute to S2 (coordination) by helping stabilize international commodity flows.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism in Smith's trade theory - how international arbitrage works and how policies like bounties affect not just domestic markets but international trade flows. It reveals the structural role of intermediary traders in market integration.

Evaluation: Merchant Carrier

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct trading role - someone who imports goods specifically for re-export rather than domestic sale. This creates a clear conceptual boundary that distinguishes merchant-carriers from other types of traders.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book IV, Chapter 5, where he explicitly discusses this type of trader and their role in the corn trade. The concept emerges naturally from Smith's analysis of bounties and trade policies.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate, as merchant-carriers are fundamentally about facilitating trade flows and market connections between different countries. This is a core exchange mechanism rather than production, distribution, or consumption.

vsm_relevance — 4.0 / 5.0

This maps well to S4 (intelligence/environmental adaptation) as merchant-carriers respond to price differentials and market opportunities across different national markets. They also contribute to S2 (coordination) by helping stabilize international commodity flows.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism in Smith's trade theory - how international arbitrage works and how policies like bounties affect not just domestic markets but international trade flows. It reveals the structural role of intermediary traders in market integration.

3.3 KiB Raw Blame History