Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

natural_balance_of_employments

null

2026-02-23T05:57:54.638449

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly articulates a distinct concept of spontaneous equilibrium among economic activities based on market signals rather than artificial interventions. It avoids circularity and provides specific criteria (profitability, resource requirements, market demands) that distinguish this balance from other forms of economic coordination.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion of drawbacks in Book IV, Chapter 4, where he explicitly argues that such policies preserve the "natural balance" that would emerge without tax distortions. The concept reflects Smith's core belief in spontaneous market equilibrium that appears throughout The Wealth of Nations.

name	value	max_value	rationale
domain_placement	4.0	5.0	"Distribution" is appropriate since this concept concerns how capital and labor are allocated across different sectors and employments. While it could also fit under "Market Mechanisms," the distributional aspect of resources among competing uses justifies the current placement.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps most naturally to S2 (coordination/anti-oscillation) as it describes how market forces coordinate different activities and prevent excessive oscillation between sectors. However, it also has elements of S3 (internal regulation) in terms of self-regulating market mechanisms, making it somewhat distributed across VSM systems.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a fundamental mechanism in Smith's economic theory—how markets spontaneously coordinate complex economic activities without central planning. It explains the structural relationship between market signals, resource allocation, and economic efficiency that underlies much of Smith's policy analysis.

Evaluation: Natural Balance Of Employments

definition_precision — 4.0 / 5.0

The definition clearly articulates a distinct concept of spontaneous equilibrium among economic activities based on market signals rather than artificial interventions. It avoids circularity and provides specific criteria (profitability, resource requirements, market demands) that distinguish this balance from other forms of economic coordination.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion of drawbacks in Book IV, Chapter 4, where he explicitly argues that such policies preserve the "natural balance" that would emerge without tax distortions. The concept reflects Smith's core belief in spontaneous market equilibrium that appears throughout The Wealth of Nations.

domain_placement — 4.0 / 5.0

"Distribution" is appropriate since this concept concerns how capital and labor are allocated across different sectors and employments. While it could also fit under "Market Mechanisms," the distributional aspect of resources among competing uses justifies the current placement.

vsm_relevance — 3.0 / 5.0

This entity maps most naturally to S2 (coordination/anti-oscillation) as it describes how market forces coordinate different activities and prevent excessive oscillation between sectors. However, it also has elements of S3 (internal regulation) in terms of self-regulating market mechanisms, making it somewhat distributed across VSM systems.

explanatory_value — 5.0 / 5.0

This entity illuminates a fundamental mechanism in Smith's economic theory—how markets spontaneously coordinate complex economic activities without central planning. It explains the structural relationship between market signals, resource allocation, and economic efficiency that underlies much of Smith's policy analysis.

4.0 KiB Raw Blame History