Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

progressive_state_of_society

null

2026-02-23T06:10:56.645081

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes this as a specific state of society characterized by advancing wealth acquisition, contrasted against stationary and declining states. It captures a distinct temporal-economic condition rather than being vague or circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's text from Book I, Chapter 8, where he explicitly discusses the progressive state as the happiest condition for society and contrasts it with stationary and declining states. The terminology and analysis are authentically Smithian.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this represents Smith's broad theoretical framework about societal development stages rather than a specific mechanism like wage determination or market operations. It's a foundational concept that spans multiple economic phenomena.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too abstract and macro-level to map naturally to specific VSM systems, as it describes an overall societal condition rather than a functional subsystem. It's more of a system-wide state description than a viable system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory power by establishing the theoretical framework for understanding when societies achieve optimal conditions for prosperity across all social orders. It illuminates the structural relationship between wealth accumulation dynamics and social welfare outcomes.

Evaluation: Progressive State Of Society

definition_precision — 4.0 / 5.0

The definition clearly distinguishes this as a specific state of society characterized by advancing wealth acquisition, contrasted against stationary and declining states. It captures a distinct temporal-economic condition rather than being vague or circular.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's text from Book I, Chapter 8, where he explicitly discusses the progressive state as the happiest condition for society and contrasts it with stationary and declining states. The terminology and analysis are authentically Smithian.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this represents Smith's broad theoretical framework about societal development stages rather than a specific mechanism like wage determination or market operations. It's a foundational concept that spans multiple economic phenomena.

vsm_relevance — 2.0 / 5.0

This entity is too abstract and macro-level to map naturally to specific VSM systems, as it describes an overall societal condition rather than a functional subsystem. It's more of a system-wide state description than a viable system component.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory power by establishing the theoretical framework for understanding when societies achieve optimal conditions for prosperity across all social orders. It illuminates the structural relationship between wealth accumulation dynamics and social welfare outcomes.

3.4 KiB Raw Blame History