Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

necessity

null

2026-02-23T06:02:00.744913

3.4

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about fundamental human requirements driving economic exchange, but it's somewhat broad and could be more precise about what constitutes "fundamental requirements" versus wants or desires. The connection between necessity and self-interested exchange is clear but could be more tightly defined.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual argument from Book I, Chapter 2, where he explicitly discusses how humans have constant need for help from others and cannot rely on benevolence alone. The concept directly reflects Smith's foundational argument about the origins of economic exchange.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placing this in the "Consumption" domain is appropriate since necessity drives what people seek to consume and obtain through exchange. However, it could arguably also belong in a broader "Exchange" or "Motivation" domain since it's really about the fundamental driver of all economic activity.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is quite abstract and doesn't map naturally to any specific VSM system - it's more of a foundational driver that underlies all systems rather than belonging to a particular operational or regulatory function. It's VSM-neutral as it represents a basic human condition rather than an organizational mechanism.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory power by illuminating the fundamental mechanism that drives economic exchange according to Smith - the inability of benevolence alone to meet human needs. It explains why self-interested exchange emerges as the primary economic coordination mechanism.

Evaluation: Necessity

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about fundamental human requirements driving economic exchange, but it's somewhat broad and could be more precise about what constitutes "fundamental requirements" versus wants or desires. The connection between necessity and self-interested exchange is clear but could be more tightly defined.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual argument from Book I, Chapter 2, where he explicitly discusses how humans have constant need for help from others and cannot rely on benevolence alone. The concept directly reflects Smith's foundational argument about the origins of economic exchange.

domain_placement — 4.0 / 5.0

Placing this in the "Consumption" domain is appropriate since necessity drives what people seek to consume and obtain through exchange. However, it could arguably also belong in a broader "Exchange" or "Motivation" domain since it's really about the fundamental driver of all economic activity.

vsm_relevance — 2.0 / 5.0

This entity is quite abstract and doesn't map naturally to any specific VSM system - it's more of a foundational driver that underlies all systems rather than belonging to a particular operational or regulatory function. It's VSM-neutral as it represents a basic human condition rather than an organizational mechanism.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory power by illuminating the fundamental mechanism that drives economic exchange according to Smith - the inability of benevolence alone to meet human needs. It explains why self-interested exchange emerges as the primary economic coordination mechanism.

3.7 KiB Raw Blame History