Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

merchant_capital

null

2026-02-23T05:51:16.078507

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes merchant capital from other forms of capital by its specific function (wholesale-to-retail trade and inter-market arbitrage) and its particular relationship to precious metals under mercantilism. It avoids circularity and captures a distinct economic concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book IV, Chapter 1, where Smith explicitly discusses merchants' capital and their role in advocating for mercantile policies that benefit their particular form of capital accumulation. The distinction between merchants' self-interest and broader social benefit is a key theme in this section.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Exchange" domain is precisely correct, as merchant capital is fundamentally about facilitating exchange between markets and different levels of the distribution chain. This is distinct from production or consumption domains.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Merchant capital maps most naturally to S1 (primary operations) as it represents a specific type of operational activity within the economic system. However, it also has S4 characteristics through its market intelligence and arbitrage functions, making its VSM placement somewhat ambiguous.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural mechanism in Smith's critique of mercantilism—how a particular class of capital owners shaped policy to benefit their specific interests. It helps explain the political economy behind mercantile policies rather than just describing surface phenomena.

Evaluation: Merchant Capital

definition_precision — 4.0 / 5.0

The definition clearly distinguishes merchant capital from other forms of capital by its specific function (wholesale-to-retail trade and inter-market arbitrage) and its particular relationship to precious metals under mercantilism. It avoids circularity and captures a distinct economic concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book IV, Chapter 1, where Smith explicitly discusses merchants' capital and their role in advocating for mercantile policies that benefit their particular form of capital accumulation. The distinction between merchants' self-interest and broader social benefit is a key theme in this section.

domain_placement — 5.0 / 5.0

Placement in the "Exchange" domain is precisely correct, as merchant capital is fundamentally about facilitating exchange between markets and different levels of the distribution chain. This is distinct from production or consumption domains.

vsm_relevance — 3.0 / 5.0

Merchant capital maps most naturally to S1 (primary operations) as it represents a specific type of operational activity within the economic system. However, it also has S4 characteristics through its market intelligence and arbitrage functions, making its VSM placement somewhat ambiguous.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural mechanism in Smith's critique of mercantilism—how a particular class of capital owners shaped policy to benefit their specific interests. It helps explain the political economy behind mercantile policies rather than just describing surface phenomena.

3.6 KiB Raw Blame History