Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

invisible_hand_mechanism

null

2026-02-23T05:38:39.173641

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures the core paradox of self-interested behavior leading to unintended social benefits through market mechanisms. It avoids circularity and distinguishes this concept from deliberate public welfare efforts.

name	value	max_value	rationale
source_grounding	5.0	5.0	This is directly grounded in Smith's famous passage from Book IV, Chapter 2, where he describes how individuals "led by an invisible hand to promote an end which was no part of his intention." The entity accurately reflects Smith's actual argument about unintended consequences of self-interest.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement as this represents one of Smith's foundational theoretical contributions that spans across multiple economic activities. It's a meta-principle rather than a specific market mechanism or policy prescription.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This concept has some relevance to S2 (coordination) as it describes how individual actions coordinate without central planning, but it's primarily a theoretical principle about emergent order rather than a specific systemic function. It operates across multiple VSM levels rather than mapping cleanly to one.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides exceptional explanatory power by illuminating the fundamental mechanism through which decentralized individual decisions can produce coordinated social outcomes. It explains a core structural relationship in Smith's economic theory rather than merely naming a surface phenomenon.

Evaluation: Invisible Hand Mechanism

definition_precision — 4.0 / 5.0

The definition clearly captures the core paradox of self-interested behavior leading to unintended social benefits through market mechanisms. It avoids circularity and distinguishes this concept from deliberate public welfare efforts.

source_grounding — 5.0 / 5.0

This is directly grounded in Smith's famous passage from Book IV, Chapter 2, where he describes how individuals "led by an invisible hand to promote an end which was no part of his intention." The entity accurately reflects Smith's actual argument about unintended consequences of self-interest.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement as this represents one of Smith's foundational theoretical contributions that spans across multiple economic activities. It's a meta-principle rather than a specific market mechanism or policy prescription.

vsm_relevance — 3.0 / 5.0

This concept has some relevance to S2 (coordination) as it describes how individual actions coordinate without central planning, but it's primarily a theoretical principle about emergent order rather than a specific systemic function. It operates across multiple VSM levels rather than mapping cleanly to one.

explanatory_value — 5.0 / 5.0

This entity provides exceptional explanatory power by illuminating the fundamental mechanism through which decentralized individual decisions can produce coordinated social outcomes. It explains a core structural relationship in Smith's economic theory rather than merely naming a surface phenomenon.

3.5 KiB Raw Blame History