Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_system_effectiveness_evaluation

null

2026-02-23T05:14:54.347867

3.8

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about evaluating economic systems, but it's somewhat broad and could apply to many forms of economic analysis. While it specifies criteria like national prosperity and consumer welfare, it lacks the precision to distinguish this from general economic policy analysis.

name	value	max_value	rationale
source_grounding	4.0	5.0	This is well-grounded in Smith's actual methodology in Book IV, Chapter 3, where he systematically evaluates mercantilist policies against criteria of economic efficiency and public benefit. The entity accurately reflects Smith's comparative approach to assessing different economic arrangements.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since this represents Smith's broader methodological approach to economic evaluation rather than a specific policy or mechanism. It captures the meta-level framework Smith uses to assess economic systems.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S4 (intelligence/environmental adaptation) as it represents the evaluative framework for assessing how well economic systems adapt to and serve their environment. It could also relate to S5 (identity/policy) in terms of establishing criteria for systemic evaluation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important structural aspect of Smith's analysis - his systematic approach to comparing economic arrangements using consistent criteria. It helps explain how Smith moves beyond mere description to principled evaluation of economic policies and systems.

Evaluation: Economic System Effectiveness Evaluation

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about evaluating economic systems, but it's somewhat broad and could apply to many forms of economic analysis. While it specifies criteria like national prosperity and consumer welfare, it lacks the precision to distinguish this from general economic policy analysis.

source_grounding — 4.0 / 5.0

This is well-grounded in Smith's actual methodology in Book IV, Chapter 3, where he systematically evaluates mercantilist policies against criteria of economic efficiency and public benefit. The entity accurately reflects Smith's comparative approach to assessing different economic arrangements.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since this represents Smith's broader methodological approach to economic evaluation rather than a specific policy or mechanism. It captures the meta-level framework Smith uses to assess economic systems.

vsm_relevance — 4.0 / 5.0

This maps well to S4 (intelligence/environmental adaptation) as it represents the evaluative framework for assessing how well economic systems adapt to and serve their environment. It could also relate to S5 (identity/policy) in terms of establishing criteria for systemic evaluation.

explanatory_value — 4.0 / 5.0

This entity illuminates an important structural aspect of Smith's analysis - his systematic approach to comparing economic arrangements using consistent criteria. It helps explain how Smith moves beyond mere description to principled evaluation of economic policies and systems.

3.5 KiB Raw Blame History