Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

capital_security_preference

null

2026-02-23T04:41:20.620541

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a specific behavioral tendency of capital owners with concrete examples (land > manufacturing > foreign trade) and identifies the underlying mechanisms (security, control, oversight). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Book III, Chapter 1 of The Wealth of Nations, where Smith explicitly discusses the natural order of capital employment and the security preferences that drive investors toward land improvement first. The entity accurately reflects Smith's actual argument about risk preferences in capital allocation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Accumulation" domain is perfectly appropriate since this concept deals with how capital is allocated and accumulated across different sectors. It directly relates to capital formation and investment decisions, which are core accumulation processes.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents how capital owners gather and process information about risk and security to make investment decisions. It also has relevance to S1 (primary operations) in terms of actual capital deployment patterns.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This concept provides significant explanatory power by illuminating the mechanism behind Smith's natural order of economic development - it's not just descriptive but explains why capital flows in particular patterns. It reveals the structural relationship between risk perception, control, and investment behavior that drives broader economic development patterns.

Evaluation: Capital Security Preference

definition_precision — 4.0 / 5.0

The definition clearly articulates a specific behavioral tendency of capital owners with concrete examples (land > manufacturing > foreign trade) and identifies the underlying mechanisms (security, control, oversight). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Book III, Chapter 1 of The Wealth of Nations, where Smith explicitly discusses the natural order of capital employment and the security preferences that drive investors toward land improvement first. The entity accurately reflects Smith's actual argument about risk preferences in capital allocation.

domain_placement — 5.0 / 5.0

The "Accumulation" domain is perfectly appropriate since this concept deals with how capital is allocated and accumulated across different sectors. It directly relates to capital formation and investment decisions, which are core accumulation processes.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents how capital owners gather and process information about risk and security to make investment decisions. It also has relevance to S1 (primary operations) in terms of actual capital deployment patterns.

explanatory_value — 5.0 / 5.0

This concept provides significant explanatory power by illuminating the mechanism behind Smith's natural order of economic development - it's not just descriptive but explains why capital flows in particular patterns. It reveals the structural relationship between risk perception, control, and investment behavior that drives broader economic development patterns.

3.8 KiB Raw Blame History