Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

natural_inclinations_thwarting

null

2026-02-23T05:59:04.028277

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly distinguishing between natural economic preferences and artificial institutional interference that disrupts capital flow. It avoids circularity by specifying the mechanism (legal/customary restrictions) and the outcome (forced investment in less preferred uses).

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how human institutions interfere with the natural order of economic development. The specific reference to the inversion of natural progression (agriculture → manufacturing → foreign trade) in European states is faithful to Smith's argument.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain placement is exactly correct, as this entity describes how regulatory and institutional constraints interfere with natural market mechanisms. This is fundamentally about the regulatory environment's impact on economic behavior.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation) as it describes how regulatory mechanisms can malfunction by constraining rather than enabling optimal resource allocation. It also has relevance to S2 (coordination) since it describes institutional failures that create oscillations away from natural economic patterns.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by identifying a key mechanism through which institutional design can distort economic development patterns. It illuminates the structural relationship between regulatory frameworks and capital allocation efficiency, going beyond mere description to explain causation.

Evaluation: Natural Inclinations Thwarting

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly distinguishing between natural economic preferences and artificial institutional interference that disrupts capital flow. It avoids circularity by specifying the mechanism (legal/customary restrictions) and the outcome (forced investment in less preferred uses).

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's analysis in Book III, Chapter 1, where he explicitly discusses how human institutions interfere with the natural order of economic development. The specific reference to the inversion of natural progression (agriculture → manufacturing → foreign trade) in European states is faithful to Smith's argument.

domain_placement — 5.0 / 5.0

The "Regulation" domain placement is exactly correct, as this entity describes how regulatory and institutional constraints interfere with natural market mechanisms. This is fundamentally about the regulatory environment's impact on economic behavior.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation) as it describes how regulatory mechanisms can malfunction by constraining rather than enabling optimal resource allocation. It also has relevance to S2 (coordination) since it describes institutional failures that create oscillations away from natural economic patterns.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by identifying a key mechanism through which institutional design can distort economic development patterns. It illuminates the structural relationship between regulatory frameworks and capital allocation efficiency, going beyond mere description to explain causation.

3.8 KiB Raw Blame History