Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

wholesale_merchants

null

2026-02-23T06:39:12.656115

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes wholesale merchants from other types of merchants by their specific function of transporting goods between regions of abundance and scarcity. It avoids circularity and captures the essential geographic arbitrage function that creates value through spatial distribution.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's explicit classification in Book II, Chapter 5, where he identifies wholesale merchants as the third method of employing capital and describes their role in transporting produce between regions. The definition accurately reflects Smith's own analysis of their economic function.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since wholesale merchants are fundamentally facilitators of trade and market creation across geographic boundaries. Their primary function is enabling exchange between surplus and deficit regions rather than production or consumption.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Wholesale merchants could map to S1 as operational units that perform the essential function of goods distribution, but they also have S4 characteristics in sensing market opportunities across regions. The VSM mapping is somewhat ambiguous as they operate across system boundaries.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates a crucial mechanism in Smith's economic system - how geographic specialization and trade are enabled through intermediaries who create markets and facilitate surplus exchange. It explains how local production limitations are overcome through spatial arbitrage rather than just naming a merchant category.

Evaluation: Wholesale Merchants

definition_precision — 4.0 / 5.0

The definition clearly distinguishes wholesale merchants from other types of merchants by their specific function of transporting goods between regions of abundance and scarcity. It avoids circularity and captures the essential geographic arbitrage function that creates value through spatial distribution.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's explicit classification in Book II, Chapter 5, where he identifies wholesale merchants as the third method of employing capital and describes their role in transporting produce between regions. The definition accurately reflects Smith's own analysis of their economic function.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since wholesale merchants are fundamentally facilitators of trade and market creation across geographic boundaries. Their primary function is enabling exchange between surplus and deficit regions rather than production or consumption.

vsm_relevance — 3.0 / 5.0

Wholesale merchants could map to S1 as operational units that perform the essential function of goods distribution, but they also have S4 characteristics in sensing market opportunities across regions. The VSM mapping is somewhat ambiguous as they operate across system boundaries.

explanatory_value — 4.0 / 5.0

This entity illuminates a crucial mechanism in Smith's economic system - how geographic specialization and trade are enabled through intermediaries who create markets and facilitate surplus exchange. It explains how local production limitations are overcome through spatial arbitrage rather than just naming a merchant category.

3.7 KiB Raw Blame History