Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_society_formation

null

2026-02-23T04:59:41.842503

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes commercial society from earlier economic forms through specific characteristics (specialized labor, market exchange, commercial relationships) and identifies what it replaces (self-sufficiency, feudal obligations, barter). The definition is precise and non-circular, though it could be slightly more specific about the mechanisms of transition.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is deeply grounded in Smith's actual analysis throughout The Wealth of Nations, particularly his discussion of the division of labor, market development, and the transition from feudal to commercial systems. Book IV, Chapter 3 specifically addresses how commercial society creates new forms of economic interdependence and governance challenges.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this concept represents a fundamental structural transformation that underlies Smith's entire analytical framework. It's not a specific policy or mechanism but rather a foundational theoretical concept about societal organization.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has some VSM relevance as it relates to how societies organize their primary operations (S1) and develop coordination mechanisms (S2), but it's primarily a macro-historical concept about societal transformation rather than a specific organizational system. It's somewhat abstract for direct VSM mapping but not entirely VSM-neutral.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides substantial explanatory power by identifying the fundamental structural shift that enables Smith's analysis of markets, division of labor, and economic growth. It illuminates the underlying social transformation that makes modern economic mechanisms possible rather than merely naming a surface phenomenon.

Evaluation: Commercial Society Formation

definition_precision — 4.0 / 5.0

The definition clearly distinguishes commercial society from earlier economic forms through specific characteristics (specialized labor, market exchange, commercial relationships) and identifies what it replaces (self-sufficiency, feudal obligations, barter). The definition is precise and non-circular, though it could be slightly more specific about the mechanisms of transition.

source_grounding — 5.0 / 5.0

This concept is deeply grounded in Smith's actual analysis throughout The Wealth of Nations, particularly his discussion of the division of labor, market development, and the transition from feudal to commercial systems. Book IV, Chapter 3 specifically addresses how commercial society creates new forms of economic interdependence and governance challenges.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this concept represents a fundamental structural transformation that underlies Smith's entire analytical framework. It's not a specific policy or mechanism but rather a foundational theoretical concept about societal organization.

vsm_relevance — 3.0 / 5.0

This entity has some VSM relevance as it relates to how societies organize their primary operations (S1) and develop coordination mechanisms (S2), but it's primarily a macro-historical concept about societal transformation rather than a specific organizational system. It's somewhat abstract for direct VSM mapping but not entirely VSM-neutral.

explanatory_value — 5.0 / 5.0

This entity provides substantial explanatory power by identifying the fundamental structural shift that enables Smith's analysis of markets, division of labor, and economic growth. It illuminates the underlying social transformation that makes modern economic mechanisms possible rather than merely naming a surface phenomenon.

4.1 KiB Raw Blame History