Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_independence_effect

null

2026-02-23T04:58:16.835043

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific causal mechanism - how commercial wealth transforms social dependencies by changing spending patterns and making tenants/retainers independent. It avoids circularity and captures a distinct transformative process rather than a vague outcome.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity directly reflects Smith's explicit argument in Book III, Chapter 4 about how commerce undermines feudal dependencies by making tenants independent through changed economic relations and allowing landlords to dismiss retainers. The mechanism is clearly articulated in the source text.

name	value	max_value	rationale
domain_placement	3.0	5.0	While this involves distributional changes in wealth and power, it's fundamentally about institutional transformation and the emergence of new governance structures. It might better belong in a "Political Economy" or "Institutional Change" domain rather than pure "Distribution."

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S4 (intelligence/environmental adaptation) as it describes how the economic system adapts to commercial development by restructuring social relations, and to S5 (identity/policy) as it involves fundamental changes in governance structures and power relations.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial structural mechanism in Smith's theory - how market forces transform feudal social relations into modern commercial society with regular government. It explains the deep connection between economic and political transformation rather than merely describing surface phenomena.

Evaluation: Commercial Independence Effect

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific causal mechanism - how commercial wealth transforms social dependencies by changing spending patterns and making tenants/retainers independent. It avoids circularity and captures a distinct transformative process rather than a vague outcome.

source_grounding — 5.0 / 5.0

This entity directly reflects Smith's explicit argument in Book III, Chapter 4 about how commerce undermines feudal dependencies by making tenants independent through changed economic relations and allowing landlords to dismiss retainers. The mechanism is clearly articulated in the source text.

domain_placement — 3.0 / 5.0

While this involves distributional changes in wealth and power, it's fundamentally about institutional transformation and the emergence of new governance structures. It might better belong in a "Political Economy" or "Institutional Change" domain rather than pure "Distribution."

vsm_relevance — 4.0 / 5.0

This maps well to S4 (intelligence/environmental adaptation) as it describes how the economic system adapts to commercial development by restructuring social relations, and to S5 (identity/policy) as it involves fundamental changes in governance structures and power relations.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial structural mechanism in Smith's theory - how market forces transform feudal social relations into modern commercial society with regular government. It explains the deep connection between economic and political transformation rather than merely describing surface phenomena.

3.6 KiB Raw Blame History