Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

home_market

null

2026-02-23T05:34:54.453007

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes the home market from foreign markets and specifies it as the domestic sphere of exchange among a country's inhabitants. It's precise and non-circular, though it could be slightly more detailed about what constitutes "domestic" in Smith's context.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is thoroughly grounded in Book IV, Chapter 5 of The Wealth of Nations, where Smith extensively discusses the primacy of the home market and argues against policies that artificially favor foreign trade over domestic commerce. The emphasis on agricultural products and policy priorities directly reflects Smith's arguments.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Exchange" domain is entirely appropriate, as the home market is fundamentally about the mechanisms and spaces where domestic exchange occurs. This is a core concept in understanding how exchange systems operate within national boundaries.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	The home market has some relevance to VSM as it represents the primary operational environment (S1) where economic transactions occur, but it's more of a structural context than a specific system function. It's neither strongly VSM-mappable nor completely abstract.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating Smith's argument about the natural priority of domestic over foreign markets and the structural importance of local exchange networks. It helps explain the foundation upon which other market mechanisms operate.

Evaluation: Home Market

definition_precision — 4.0 / 5.0

The definition clearly distinguishes the home market from foreign markets and specifies it as the domestic sphere of exchange among a country's inhabitants. It's precise and non-circular, though it could be slightly more detailed about what constitutes "domestic" in Smith's context.

source_grounding — 5.0 / 5.0

This concept is thoroughly grounded in Book IV, Chapter 5 of The Wealth of Nations, where Smith extensively discusses the primacy of the home market and argues against policies that artificially favor foreign trade over domestic commerce. The emphasis on agricultural products and policy priorities directly reflects Smith's arguments.

domain_placement — 5.0 / 5.0

Placement in the "Exchange" domain is entirely appropriate, as the home market is fundamentally about the mechanisms and spaces where domestic exchange occurs. This is a core concept in understanding how exchange systems operate within national boundaries.

vsm_relevance — 3.0 / 5.0

The home market has some relevance to VSM as it represents the primary operational environment (S1) where economic transactions occur, but it's more of a structural context than a specific system function. It's neither strongly VSM-mappable nor completely abstract.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating Smith's argument about the natural priority of domestic over foreign markets and the structural importance of local exchange networks. It helps explain the foundation upon which other market mechanisms operate.

3.5 KiB Raw Blame History