Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_context

null

2026-02-23T05:14:09.117271

3.8

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a meaningful concept about contextual factors shaping economic systems, but it's somewhat broad and could benefit from more precise boundaries. The phrase "circumstances that shape" is clear but the enumeration of factors (stage of opulence, technology, culture) feels somewhat open-ended rather than definitively bounded.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's explicit recognition that different ages and nations produce different economic systems, which is a clear theme throughout Book IV. The concept directly reflects Smith's comparative approach to analyzing mercantile versus other systems across different historical and geographical contexts.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is an appropriate domain placement since this concept operates at a meta-level about how economic systems emerge and function across different contexts. It's foundational to understanding Smith's broader theoretical framework rather than being specific to particular economic mechanisms.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps naturally to S4 (intelligence/environmental adaptation) as it concerns how economic systems must adapt to and reflect their environmental context. It also has relevance to S5 (identity/policy) in terms of how contextual factors shape the fundamental character and policy orientation of economic arrangements.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating why different economic systems emerge in different contexts rather than treating economic arrangements as universal. It helps explain the structural relationship between environmental conditions and institutional forms, which is central to Smith's analytical method.

Evaluation: Economic System Context

definition_precision — 3.0 / 5.0

The definition captures a meaningful concept about contextual factors shaping economic systems, but it's somewhat broad and could benefit from more precise boundaries. The phrase "circumstances that shape" is clear but the enumeration of factors (stage of opulence, technology, culture) feels somewhat open-ended rather than definitively bounded.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's explicit recognition that different ages and nations produce different economic systems, which is a clear theme throughout Book IV. The concept directly reflects Smith's comparative approach to analyzing mercantile versus other systems across different historical and geographical contexts.

domain_placement — 4.0 / 5.0

"General Theory" is an appropriate domain placement since this concept operates at a meta-level about how economic systems emerge and function across different contexts. It's foundational to understanding Smith's broader theoretical framework rather than being specific to particular economic mechanisms.

vsm_relevance — 4.0 / 5.0

This entity maps naturally to S4 (intelligence/environmental adaptation) as it concerns how economic systems must adapt to and reflect their environmental context. It also has relevance to S5 (identity/policy) in terms of how contextual factors shape the fundamental character and policy orientation of economic arrangements.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating why different economic systems emerge in different contexts rather than treating economic arrangements as universal. It helps explain the structural relationship between environmental conditions and institutional forms, which is central to Smith's analytical method.

3.9 KiB Raw Blame History