Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

subsistence

null

2026-02-23T06:27:28.306675

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies subsistence as basic survival necessities and precisely explains how they are obtained (charity for beggars, exchange for others). The concept is distinct and well-bounded, though it could be slightly more specific about what constitutes "basic necessities."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual argument from Book I, Chapter 2, where he uses the beggar example to demonstrate that even those dependent on charity ultimately rely on exchange mechanisms. The definition accurately reflects Smith's reasoning about universal economic exchange.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Consumption" is the correct domain placement since subsistence represents the most fundamental level of consumption—the baseline goods and services required for survival. This clearly falls within consumption theory rather than production, distribution, or other economic categories.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Subsistence has moderate VSM relevance as it relates to S1 (basic operational requirements for system survival) and potentially S5 (fundamental identity/viability requirements). However, it's more of a baseline condition than an active system component, making the VSM mapping somewhat indirect.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory value by illuminating Smith's fundamental insight that all economic actors, even those seemingly outside market mechanisms, ultimately depend on exchange relationships. It reveals the universal necessity of economic cooperation and trade for human survival.

Evaluation: Subsistence

definition_precision — 4.0 / 5.0

The definition clearly identifies subsistence as basic survival necessities and precisely explains how they are obtained (charity for beggars, exchange for others). The concept is distinct and well-bounded, though it could be slightly more specific about what constitutes "basic necessities."

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual argument from Book I, Chapter 2, where he uses the beggar example to demonstrate that even those dependent on charity ultimately rely on exchange mechanisms. The definition accurately reflects Smith's reasoning about universal economic exchange.

domain_placement — 5.0 / 5.0

"Consumption" is the correct domain placement since subsistence represents the most fundamental level of consumption—the baseline goods and services required for survival. This clearly falls within consumption theory rather than production, distribution, or other economic categories.

vsm_relevance — 3.0 / 5.0

Subsistence has moderate VSM relevance as it relates to S1 (basic operational requirements for system survival) and potentially S5 (fundamental identity/viability requirements). However, it's more of a baseline condition than an active system component, making the VSM mapping somewhat indirect.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory value by illuminating Smith's fundamental insight that all economic actors, even those seemingly outside market mechanisms, ultimately depend on exchange relationships. It reveals the universal necessity of economic cooperation and trade for human survival.

3.6 KiB Raw Blame History