Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

benevolence

null

2026-02-23T04:38:07.392725

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes benevolence as a natural human disposition toward kindness/goodwill and precisely explains its limitation as an economic organizing principle. It avoids circularity and captures Smith's specific argument about why benevolence alone cannot sustain complex economic systems.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's famous passage from Book I, Chapter 2 about not expecting dinner from the butcher's benevolence but from his self-interest. The contrast between benevolence and self-interest as economic motivations is central to Smith's argument in this foundational chapter.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since benevolence represents a fundamental theoretical concept in Smith's framework for understanding human motivation and economic organization. This is a core theoretical principle rather than a specific economic mechanism or policy consideration.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Benevolence is too abstract and philosophical to map naturally to specific VSM systems, as it represents a general human disposition rather than an organizational function. While it might tangentially relate to S5 (identity/values), it doesn't correspond to any particular systemic operation within the VSM framework.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by illuminating why Smith argues self-interest rather than altruism forms the reliable foundation for economic cooperation. It helps explain a crucial structural relationship in Smith's theory about what makes market systems viable and sustainable.

Evaluation: Benevolence

definition_precision — 4.0 / 5.0

The definition clearly distinguishes benevolence as a natural human disposition toward kindness/goodwill and precisely explains its limitation as an economic organizing principle. It avoids circularity and captures Smith's specific argument about why benevolence alone cannot sustain complex economic systems.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's famous passage from Book I, Chapter 2 about not expecting dinner from the butcher's benevolence but from his self-interest. The contrast between benevolence and self-interest as economic motivations is central to Smith's argument in this foundational chapter.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since benevolence represents a fundamental theoretical concept in Smith's framework for understanding human motivation and economic organization. This is a core theoretical principle rather than a specific economic mechanism or policy consideration.

vsm_relevance — 2.0 / 5.0

Benevolence is too abstract and philosophical to map naturally to specific VSM systems, as it represents a general human disposition rather than an organizational function. While it might tangentially relate to S5 (identity/values), it doesn't correspond to any particular systemic operation within the VSM framework.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by illuminating why Smith argues self-interest rather than altruism forms the reliable foundation for economic cooperation. It helps explain a crucial structural relationship in Smith's theory about what makes market systems viable and sustainable.

3.7 KiB Raw Blame History