Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

artificial_direction_of_industry

null

2026-02-23T00:35:22.351545

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes artificial direction from natural market forces and specifies the mechanisms (regulations, prohibitions, incentives) by which government intervenes. It captures a distinct concept of deliberate resource misallocation rather than being a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's core arguments from Book IV, Chapter 2, where he extensively critiques government attempts to direct industry and capital allocation. The concept and examples (domestic vs. foreign manufacturing) align precisely with Smith's text.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain placement as this concept specifically concerns government regulatory intervention in markets. It represents a clear regulatory mechanism rather than belonging to trade, production, or other economic categories.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation) as it represents regulatory control mechanisms, and potentially S4 (intelligence/adaptation) regarding how systems respond to environmental pressures. It has clear structural relevance to organizational control systems.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a fundamental mechanism of how government intervention distorts natural resource allocation patterns and creates inefficiencies. It explains the structural relationship between regulatory intervention and economic outcomes, providing genuine analytical insight into market dynamics.

Evaluation: Artificial Direction Of Industry

definition_precision — 4.0 / 5.0

The definition clearly distinguishes artificial direction from natural market forces and specifies the mechanisms (regulations, prohibitions, incentives) by which government intervenes. It captures a distinct concept of deliberate resource misallocation rather than being a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's core arguments from Book IV, Chapter 2, where he extensively critiques government attempts to direct industry and capital allocation. The concept and examples (domestic vs. foreign manufacturing) align precisely with Smith's text.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain placement as this concept specifically concerns government regulatory intervention in markets. It represents a clear regulatory mechanism rather than belonging to trade, production, or other economic categories.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation) as it represents regulatory control mechanisms, and potentially S4 (intelligence/adaptation) regarding how systems respond to environmental pressures. It has clear structural relevance to organizational control systems.

explanatory_value — 5.0 / 5.0

This entity illuminates a fundamental mechanism of how government intervention distorts natural resource allocation patterns and creates inefficiencies. It explains the structural relationship between regulatory intervention and economic outcomes, providing genuine analytical insight into market dynamics.

3.5 KiB Raw Blame History