Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commerce_of_towns

null

2026-02-23T04:57:24.775323

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly distinguishing urban commercial activities from other forms of trade and specifying the three mechanisms by which it drives rural improvement. It avoids circularity and captures a distinct concept rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book III, Chapter 4, which explicitly discusses how commerce in towns creates markets for rural produce and leads to wealthy merchants purchasing and improving lands. The three mechanisms described are core arguments Smith makes in this chapter.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this concept fundamentally concerns trading relationships, market creation, and the flow of goods and capital between urban and rural areas. This is quintessentially about exchange mechanisms in Smith's economic system.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S1 (primary operations of commercial exchange) and S4 (intelligence/adaptation as towns respond to rural opportunities and vice versa). The feedback loops between urban commerce and rural improvement represent clear VSM dynamics rather than being too abstract to place.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the specific mechanism through which urban commercial activity drives broader economic development and social order. It reveals a structural relationship that is central to Smith's theory of how commercial society develops and improves itself.

Evaluation: Commerce Of Towns

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly distinguishing urban commercial activities from other forms of trade and specifying the three mechanisms by which it drives rural improvement. It avoids circularity and captures a distinct concept rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book III, Chapter 4, which explicitly discusses how commerce in towns creates markets for rural produce and leads to wealthy merchants purchasing and improving lands. The three mechanisms described are core arguments Smith makes in this chapter.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this concept fundamentally concerns trading relationships, market creation, and the flow of goods and capital between urban and rural areas. This is quintessentially about exchange mechanisms in Smith's economic system.

vsm_relevance — 4.0 / 5.0

This entity maps well to S1 (primary operations of commercial exchange) and S4 (intelligence/adaptation as towns respond to rural opportunities and vice versa). The feedback loops between urban commerce and rural improvement represent clear VSM dynamics rather than being too abstract to place.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the specific mechanism through which urban commercial activity drives broader economic development and social order. It reveals a structural relationship that is central to Smith's theory of how commercial society develops and improves itself.

3.5 KiB Raw Blame History