feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: home_market
evaluator: null
evaluated_at: '2026-02-23T05:34:54.453007'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes the home market from foreign markets
and specifies it as the domestic sphere of exchange among a country's inhabitants.
It's precise and non-circular, though it could be slightly more detailed about
what constitutes "domestic" in Smith's context.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is thoroughly grounded in Book IV, Chapter 5 of The Wealth
of Nations, where Smith extensively discusses the primacy of the home market and
argues against policies that artificially favor foreign trade over domestic commerce.
The emphasis on agricultural products and policy priorities directly reflects
Smith's arguments.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: Placement in the "Exchange" domain is entirely appropriate, as the home
market is fundamentally about the mechanisms and spaces where domestic exchange
occurs. This is a core concept in understanding how exchange systems operate within
national boundaries.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: The home market has some relevance to VSM as it represents the primary
operational environment (S1) where economic transactions occur, but it's more
of a structural context than a specific system function. It's neither strongly
VSM-mappable nor completely abstract.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides significant explanatory value by illuminating Smith's
argument about the natural priority of domestic over foreign markets and the structural
importance of local exchange networks. It helps explain the foundation upon which
other market mechanisms operate.
---
# Evaluation: Home Market
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes the home market from foreign markets and specifies it as the domestic sphere of exchange among a country's inhabitants. It's precise and non-circular, though it could be slightly more detailed about what constitutes "domestic" in Smith's context.
## source_grounding — 5.0 / 5.0
This concept is thoroughly grounded in Book IV, Chapter 5 of The Wealth of Nations, where Smith extensively discusses the primacy of the home market and argues against policies that artificially favor foreign trade over domestic commerce. The emphasis on agricultural products and policy priorities directly reflects Smith's arguments.
## domain_placement — 5.0 / 5.0
Placement in the "Exchange" domain is entirely appropriate, as the home market is fundamentally about the mechanisms and spaces where domestic exchange occurs. This is a core concept in understanding how exchange systems operate within national boundaries.
## vsm_relevance — 3.0 / 5.0
The home market has some relevance to VSM as it represents the primary operational environment (S1) where economic transactions occur, but it's more of a structural context than a specific system function. It's neither strongly VSM-mappable nor completely abstract.
## explanatory_value — 4.0 / 5.0
This entity provides significant explanatory value by illuminating Smith's argument about the natural priority of domestic over foreign markets and the structural importance of local exchange networks. It helps explain the foundation upon which other market mechanisms operate.