Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

self_love

null

2026-02-23T06:20:56.568789

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes self-love from benevolence and identifies it as concern for one's own advantage, making it a precise and non-circular concept. It captures Smith's specific usage rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's famous passage from Book I, Chapter 2 about appealing to self-love rather than benevolence of the butcher, brewer, and baker. The definition accurately reflects Smith's actual argument about the foundation of economic exchange.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the correct domain placement since self-love is one of Smith's fundamental theoretical principles underlying all economic behavior. It's not specific to production, exchange, or any particular economic sector but rather foundational to his entire system.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Self-love is too fundamental and abstract to map naturally to any specific VSM system—it operates across all levels as a basic motivational principle. While it influences all systems (S1-S5), it doesn't have a natural home in any particular one.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power by identifying the psychological mechanism that makes economic cooperation reliable and predictable. It illuminates why market exchange works systematically rather than depending on variable human goodwill.

Evaluation: Self Love

definition_precision — 4.0 / 5.0

The definition clearly distinguishes self-love from benevolence and identifies it as concern for one's own advantage, making it a precise and non-circular concept. It captures Smith's specific usage rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's famous passage from Book I, Chapter 2 about appealing to self-love rather than benevolence of the butcher, brewer, and baker. The definition accurately reflects Smith's actual argument about the foundation of economic exchange.

domain_placement — 5.0 / 5.0

"General Theory" is the correct domain placement since self-love is one of Smith's fundamental theoretical principles underlying all economic behavior. It's not specific to production, exchange, or any particular economic sector but rather foundational to his entire system.

vsm_relevance — 2.0 / 5.0

Self-love is too fundamental and abstract to map naturally to any specific VSM system—it operates across all levels as a basic motivational principle. While it influences all systems (S1-S5), it doesn't have a natural home in any particular one.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power by identifying the psychological mechanism that makes economic cooperation reliable and predictable. It illuminates why market exchange works systematically rather than depending on variable human goodwill.

3.2 KiB Raw Blame History