Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

favour

null

2026-02-23T05:27:58.544624

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes favour from contractual exchange and market transactions, establishing it as benefits granted through goodwill rather than obligation. It avoids circularity and captures a distinct concept that Smith uses to contrast with market mechanisms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 2, where he explicitly discusses how animals gain favour and contrasts this with human economic organization. The definition accurately reflects Smith's argument about favour's limitations in complex societies.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Exchange" domain is highly appropriate since Smith uses favour specifically to contrast with market exchange mechanisms. The concept is fundamentally about alternative modes of obtaining goods and services.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Favour is more of a pre-systemic or anti-systemic concept that represents what economic organization moves away from rather than a component of viable economic systems. It doesn't naturally map to any specific VSM system since it represents the absence of systematic coordination.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The concept provides significant explanatory value by illuminating why market mechanisms emerge as superior to personal relationships for complex economic coordination. It helps explain the structural necessity of impersonal exchange systems in advanced societies.

Evaluation: Favour

definition_precision — 4.0 / 5.0

The definition clearly distinguishes favour from contractual exchange and market transactions, establishing it as benefits granted through goodwill rather than obligation. It avoids circularity and captures a distinct concept that Smith uses to contrast with market mechanisms.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 2, where he explicitly discusses how animals gain favour and contrasts this with human economic organization. The definition accurately reflects Smith's argument about favour's limitations in complex societies.

domain_placement — 5.0 / 5.0

Placement in the "Exchange" domain is highly appropriate since Smith uses favour specifically to contrast with market exchange mechanisms. The concept is fundamentally about alternative modes of obtaining goods and services.

vsm_relevance — 2.0 / 5.0

Favour is more of a pre-systemic or anti-systemic concept that represents what economic organization moves away from rather than a component of viable economic systems. It doesn't naturally map to any specific VSM system since it represents the absence of systematic coordination.

explanatory_value — 4.0 / 5.0

The concept provides significant explanatory value by illuminating why market mechanisms emerge as superior to personal relationships for complex economic coordination. It helps explain the structural necessity of impersonal exchange systems in advanced societies.

3.3 KiB Raw Blame History