Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_system_transformation

null

2026-02-23T05:00:17.791888

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between mercantilist policies (government regulation, precious metal accumulation) and free market principles (voluntary exchange, competition). It captures a specific transformational concept rather than being vague, though it could be slightly more precise about the mechanisms of transformation.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual arguments in Book IV, Chapter 6, where he explicitly critiques the mercantile system and advocates for free market principles. The concept of transformation from mercantilism to free markets is central to Smith's thesis in The Wealth of Nations.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this represents Smith's overarching theoretical framework for economic transformation. This is a foundational theoretical concept that spans multiple specific economic mechanisms and policies.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents a systemic response to changing economic understanding and environmental conditions. It also relates to S5 (identity/policy) as it involves fundamental shifts in economic policy orientation and national economic identity.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanism of how economies can transition from one organizing principle (mercantilism) to another (free markets). It explains both the process and rationale for fundamental economic system change that Smith advocates throughout his work.

Evaluation: Commercial System Transformation

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between mercantilist policies (government regulation, precious metal accumulation) and free market principles (voluntary exchange, competition). It captures a specific transformational concept rather than being vague, though it could be slightly more precise about the mechanisms of transformation.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual arguments in Book IV, Chapter 6, where he explicitly critiques the mercantile system and advocates for free market principles. The concept of transformation from mercantilism to free markets is central to Smith's thesis in The Wealth of Nations.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this represents Smith's overarching theoretical framework for economic transformation. This is a foundational theoretical concept that spans multiple specific economic mechanisms and policies.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents a systemic response to changing economic understanding and environmental conditions. It also relates to S5 (identity/policy) as it involves fundamental shifts in economic policy orientation and national economic identity.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanism of how economies can transition from one organizing principle (mercantilism) to another (free markets). It explains both the process and rationale for fundamental economic system change that Smith advocates throughout his work.

3.7 KiB Raw Blame History