feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,68 @@
---
entity_slug: commercial_society_formation
evaluator: null
evaluated_at: '2026-02-23T04:59:41.842503'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes commercial society from earlier
economic forms through specific characteristics (specialized labor, market exchange,
commercial relationships) and identifies what it replaces (self-sufficiency, feudal
obligations, barter). The definition is precise and non-circular, though it could
be slightly more specific about the mechanisms of transition.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is deeply grounded in Smith's actual analysis throughout
The Wealth of Nations, particularly his discussion of the division of labor, market
development, and the transition from feudal to commercial systems. Book IV, Chapter
3 specifically addresses how commercial society creates new forms of economic
interdependence and governance challenges.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this concept
represents a fundamental structural transformation that underlies Smith''s entire
analytical framework. It''s not a specific policy or mechanism but rather a foundational
theoretical concept about societal organization.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has some VSM relevance as it relates to how societies organize
their primary operations (S1) and develop coordination mechanisms (S2), but it's
primarily a macro-historical concept about societal transformation rather than
a specific organizational system. It's somewhat abstract for direct VSM mapping
but not entirely VSM-neutral.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides substantial explanatory power by identifying the
fundamental structural shift that enables Smith's analysis of markets, division
of labor, and economic growth. It illuminates the underlying social transformation
that makes modern economic mechanisms possible rather than merely naming a surface
phenomenon.
---
# Evaluation: Commercial Society Formation
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes commercial society from earlier economic forms through specific characteristics (specialized labor, market exchange, commercial relationships) and identifies what it replaces (self-sufficiency, feudal obligations, barter). The definition is precise and non-circular, though it could be slightly more specific about the mechanisms of transition.
## source_grounding — 5.0 / 5.0
This concept is deeply grounded in Smith's actual analysis throughout The Wealth of Nations, particularly his discussion of the division of labor, market development, and the transition from feudal to commercial systems. Book IV, Chapter 3 specifically addresses how commercial society creates new forms of economic interdependence and governance challenges.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this concept represents a fundamental structural transformation that underlies Smith's entire analytical framework. It's not a specific policy or mechanism but rather a foundational theoretical concept about societal organization.
## vsm_relevance — 3.0 / 5.0
This entity has some VSM relevance as it relates to how societies organize their primary operations (S1) and develop coordination mechanisms (S2), but it's primarily a macro-historical concept about societal transformation rather than a specific organizational system. It's somewhat abstract for direct VSM mapping but not entirely VSM-neutral.
## explanatory_value — 5.0 / 5.0
This entity provides substantial explanatory power by identifying the fundamental structural shift that enables Smith's analysis of markets, division of labor, and economic growth. It illuminates the underlying social transformation that makes modern economic mechanisms possible rather than merely naming a surface phenomenon.