Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

economic_systems_distinction

null

2026-02-23T05:22:04.958840

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a legitimate conceptual distinction but remains somewhat vague with phrases like "different approaches to organizing economic activity." While it identifies the commercial vs. agricultural contrast, it doesn't precisely delineate what constitutes each system or their specific characteristics.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual framework from Book IV, where he explicitly analyzes different systems of political economy, particularly contrasting mercantile/commercial systems with physiocratic/agricultural approaches. The distinction between these systems is a central organizing principle of his work.

name	value	max_value	rationale
domain_placement	5.0	5.0	"General Theory" is the appropriate domain placement since this represents Smith's foundational theoretical framework for understanding different economic arrangements. This meta-level distinction underpins his subsequent analysis of specific policies and mechanisms.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps naturally to S4 (intelligence/environmental adaptation) as it represents Smith's analytical framework for understanding how different economic systems adapt to and shape their environments. It could also relate to S5 (identity/policy) as it concerns fundamental choices about economic organization.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides significant explanatory value by establishing the conceptual foundation for understanding why different economic policies and institutions emerge in different contexts. It illuminates the structural logic behind Smith's comparative analysis of economic systems rather than merely describing surface phenomena.

Evaluation: Economic Systems Distinction

definition_precision — 3.0 / 5.0

The definition captures a legitimate conceptual distinction but remains somewhat vague with phrases like "different approaches to organizing economic activity." While it identifies the commercial vs. agricultural contrast, it doesn't precisely delineate what constitutes each system or their specific characteristics.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual framework from Book IV, where he explicitly analyzes different systems of political economy, particularly contrasting mercantile/commercial systems with physiocratic/agricultural approaches. The distinction between these systems is a central organizing principle of his work.

domain_placement — 5.0 / 5.0

"General Theory" is the appropriate domain placement since this represents Smith's foundational theoretical framework for understanding different economic arrangements. This meta-level distinction underpins his subsequent analysis of specific policies and mechanisms.

vsm_relevance — 4.0 / 5.0

This entity maps naturally to S4 (intelligence/environmental adaptation) as it represents Smith's analytical framework for understanding how different economic systems adapt to and shape their environments. It could also relate to S5 (identity/policy) as it concerns fundamental choices about economic organization.

explanatory_value — 4.0 / 5.0

This entity provides significant explanatory value by establishing the conceptual foundation for understanding why different economic policies and institutions emerge in different contexts. It illuminates the structural logic behind Smith's comparative analysis of economic systems rather than merely describing surface phenomena.

3.8 KiB Raw Blame History