Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

equal_profit_employment_choice

null

2026-02-23T05:23:51.894009

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly specifying the conditions (equal profits) and the specific preference (land improvement over manufacturing/trade) along with the underlying reasons (security, visibility, control). It captures a distinct behavioral pattern rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual argument from Book III, Chapter 1, where he explicitly discusses the natural preference for agricultural investment when returns are equal, as part of his analysis of the natural progress of opulence. The concept directly reflects Smith's text rather than imposing external interpretations.

name	value	max_value	rationale
domain_placement	5.0	5.0	The placement in "Accumulation" domain is correct, as this concept deals directly with capital allocation decisions and investment choices. It fits naturally within Smith's broader discussion of how capital accumulates and gets deployed across different sectors of the economy.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it involves decision-making about resource allocation based on environmental factors like security and risk assessment. However, it's somewhat abstract and doesn't clearly align with operational VSM functions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides genuine explanatory value by illuminating the mechanism behind capital allocation decisions when financial returns are equivalent—showing how non-financial factors like security and control influence economic behavior. It helps explain Smith's theory of natural economic development patterns.

Evaluation: Equal Profit Employment Choice

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly specifying the conditions (equal profits) and the specific preference (land improvement over manufacturing/trade) along with the underlying reasons (security, visibility, control). It captures a distinct behavioral pattern rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual argument from Book III, Chapter 1, where he explicitly discusses the natural preference for agricultural investment when returns are equal, as part of his analysis of the natural progress of opulence. The concept directly reflects Smith's text rather than imposing external interpretations.

domain_placement — 5.0 / 5.0

The placement in "Accumulation" domain is correct, as this concept deals directly with capital allocation decisions and investment choices. It fits naturally within Smith's broader discussion of how capital accumulates and gets deployed across different sectors of the economy.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it involves decision-making about resource allocation based on environmental factors like security and risk assessment. However, it's somewhat abstract and doesn't clearly align with operational VSM functions.

explanatory_value — 4.0 / 5.0

The entity provides genuine explanatory value by illuminating the mechanism behind capital allocation decisions when financial returns are equivalent—showing how non-financial factors like security and control influence economic behavior. It helps explain Smith's theory of natural economic development patterns.

3.8 KiB Raw Blame History