Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

human_nature

null

2026-02-23T05:35:37.490910

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific concept - the universal human propensity to truck, barter, and exchange - rather than using vague language. It avoids circularity by grounding the concept in observable behavioral tendencies that distinguish humans from other animals.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly and extensively grounded in Smith's actual text from Book I, Chapter 2, where he explicitly discusses the propensity to exchange as fundamental to human nature. The definition accurately reflects Smith's own language and reasoning about this being either an original principle or consequence of reason and speech.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since human nature serves as Smith's foundational assumption underlying all economic behavior and organization. This concept operates at the most basic theoretical level, informing his entire framework rather than belonging to a specific economic mechanism.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too fundamental and abstract to map naturally to any specific VSM system - it represents a basic assumption about human behavior that would underlie all systems rather than corresponding to operational, coordination, or regulatory functions. It's more of a foundational premise than a systemic component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides crucial explanatory power by identifying the fundamental mechanism that Smith believes drives economic organization and the division of labor. It explains why markets and exchange systems emerge naturally rather than merely describing surface economic phenomena.

Evaluation: Human Nature

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific concept - the universal human propensity to truck, barter, and exchange - rather than using vague language. It avoids circularity by grounding the concept in observable behavioral tendencies that distinguish humans from other animals.

source_grounding — 5.0 / 5.0

This entity is directly and extensively grounded in Smith's actual text from Book I, Chapter 2, where he explicitly discusses the propensity to exchange as fundamental to human nature. The definition accurately reflects Smith's own language and reasoning about this being either an original principle or consequence of reason and speech.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since human nature serves as Smith's foundational assumption underlying all economic behavior and organization. This concept operates at the most basic theoretical level, informing his entire framework rather than belonging to a specific economic mechanism.

vsm_relevance — 2.0 / 5.0

This entity is too fundamental and abstract to map naturally to any specific VSM system - it represents a basic assumption about human behavior that would underlie all systems rather than corresponding to operational, coordination, or regulatory functions. It's more of a foundational premise than a systemic component.

explanatory_value — 5.0 / 5.0

This entity provides crucial explanatory power by identifying the fundamental mechanism that Smith believes drives economic organization and the division of labor. It explains why markets and exchange systems emerge naturally rather than merely describing surface economic phenomena.

3.7 KiB Raw Blame History