Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

entail

null

2026-02-23T05:23:28.329411

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise and non-circular, clearly distinguishing entails as a specific legal mechanism that restricts property alienation through inheritance constraints. It captures the distinct concept of binding property to family lines rather than using vague terminology.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual analysis in Book III, Chapter 2, where he explicitly discusses entails as consequences of primogeniture and critiques their economic effects. The definition accurately reflects Smith's treatment of entails as both historically rational and contemporaneously problematic.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain placement is perfectly appropriate, as entails represent legal-institutional constraints on property markets and land use. This fits squarely within regulatory mechanisms that shape economic behavior through legal restrictions.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Entails map well to S3 (internal regulation) as institutional constraints that govern property allocation within the economic system, and potentially to S2 as coordination mechanisms that prevent certain market oscillations. The regulatory nature gives it clear VSM relevance rather than being abstractly neutral.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by illuminating the structural mechanism through which legal institutions constrain efficient resource allocation and market function. It reveals how historical institutional forms can persist beyond their functional utility and impede economic development.

Evaluation: Entail

definition_precision — 5.0 / 5.0

The definition is highly precise and non-circular, clearly distinguishing entails as a specific legal mechanism that restricts property alienation through inheritance constraints. It captures the distinct concept of binding property to family lines rather than using vague terminology.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual analysis in Book III, Chapter 2, where he explicitly discusses entails as consequences of primogeniture and critiques their economic effects. The definition accurately reflects Smith's treatment of entails as both historically rational and contemporaneously problematic.

domain_placement — 5.0 / 5.0

The "Regulation" domain placement is perfectly appropriate, as entails represent legal-institutional constraints on property markets and land use. This fits squarely within regulatory mechanisms that shape economic behavior through legal restrictions.

vsm_relevance — 4.0 / 5.0

Entails map well to S3 (internal regulation) as institutional constraints that govern property allocation within the economic system, and potentially to S2 as coordination mechanisms that prevent certain market oscillations. The regulatory nature gives it clear VSM relevance rather than being abstractly neutral.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by illuminating the structural mechanism through which legal institutions constrain efficient resource allocation and market function. It reveals how historical institutional forms can persist beyond their functional utility and impede economic development.

3.6 KiB Raw Blame History