feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: rural_urban_reciprocity
evaluator: null
evaluated_at: '2026-02-23T06:19:52.428139'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly articulates a specific concept of mutual economic
dependency between rural and urban areas through specialized production and exchange.
It avoids circularity and distinguishes this reciprocal relationship from simple
trade by emphasizing the balanced, mutually beneficial nature of the exchange.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's text, particularly Book
III, Chapter 1, where he explicitly discusses how towns and countryside serve
each other's needs through specialization. Smith uses this relationship as a key
example to counter mercantilist zero-sum thinking about trade.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate for this concept, as it
fundamentally concerns the mechanisms and benefits of commercial exchange between
different economic sectors. The reciprocal nature of the relationship is central
to Smith's theory of exchange and market dynamics.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S1 (as
a fundamental operational relationship) or S2 (as a coordination mechanism between
different economic sectors). However, it's more of a structural relationship than
a clear system function, making VSM placement somewhat ambiguous.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating how
the division of labor creates mutual benefits rather than winners and losers,
which is fundamental to Smith's critique of mercantilism. It explains a key mechanism
by which commercial society generates prosperity for all participants through
specialization.
---
# Evaluation: Rural Urban Reciprocity
## definition_precision — 4.0 / 5.0
The definition clearly articulates a specific concept of mutual economic dependency between rural and urban areas through specialized production and exchange. It avoids circularity and distinguishes this reciprocal relationship from simple trade by emphasizing the balanced, mutually beneficial nature of the exchange.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's text, particularly Book III, Chapter 1, where he explicitly discusses how towns and countryside serve each other's needs through specialization. Smith uses this relationship as a key example to counter mercantilist zero-sum thinking about trade.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate for this concept, as it fundamentally concerns the mechanisms and benefits of commercial exchange between different economic sectors. The reciprocal nature of the relationship is central to Smith's theory of exchange and market dynamics.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S1 (as a fundamental operational relationship) or S2 (as a coordination mechanism between different economic sectors). However, it's more of a structural relationship than a clear system function, making VSM placement somewhat ambiguous.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating how the division of labor creates mutual benefits rather than winners and losers, which is fundamental to Smith's critique of mercantilism. It explains a key mechanism by which commercial society generates prosperity for all participants through specialization.