feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: commerce_of_towns
evaluator: null
evaluated_at: '2026-02-23T04:57:24.775323'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is quite precise, clearly distinguishing urban commercial
activities from other forms of trade and specifying the three mechanisms by which
it drives rural improvement. It avoids circularity and captures a distinct concept
rather than being a vague umbrella term.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Book III, Chapter 4, which explicitly
discusses how commerce in towns creates markets for rural produce and leads to
wealthy merchants purchasing and improving lands. The three mechanisms described
are core arguments Smith makes in this chapter.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since this concept fundamentally
concerns trading relationships, market creation, and the flow of goods and capital
between urban and rural areas. This is quintessentially about exchange mechanisms
in Smith's economic system.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S1 (primary operations of commercial exchange)
and S4 (intelligence/adaptation as towns respond to rural opportunities and vice
versa). The feedback loops between urban commerce and rural improvement represent
clear VSM dynamics rather than being too abstract to place.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory power by illuminating the
specific mechanism through which urban commercial activity drives broader economic
development and social order. It reveals a structural relationship that is central
to Smith's theory of how commercial society develops and improves itself.
---
# Evaluation: Commerce Of Towns
## definition_precision — 4.0 / 5.0
The definition is quite precise, clearly distinguishing urban commercial activities from other forms of trade and specifying the three mechanisms by which it drives rural improvement. It avoids circularity and captures a distinct concept rather than being a vague umbrella term.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Book III, Chapter 4, which explicitly discusses how commerce in towns creates markets for rural produce and leads to wealthy merchants purchasing and improving lands. The three mechanisms described are core arguments Smith makes in this chapter.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since this concept fundamentally concerns trading relationships, market creation, and the flow of goods and capital between urban and rural areas. This is quintessentially about exchange mechanisms in Smith's economic system.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S1 (primary operations of commercial exchange) and S4 (intelligence/adaptation as towns respond to rural opportunities and vice versa). The feedback loops between urban commerce and rural improvement represent clear VSM dynamics rather than being too abstract to place.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory power by illuminating the specific mechanism through which urban commercial activity drives broader economic development and social order. It reveals a structural relationship that is central to Smith's theory of how commercial society develops and improves itself.