Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.1 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_principles

null

2026-02-23T04:55:21.608735

3.2

name	value	max_value	rationale
definition_precision	2.0	5.0	The definition is vague and circular, essentially saying "principles that underlie colonial economic arrangements should be based on principles of natural liberty." It doesn't clearly distinguish what makes these principles specifically about colonies versus general economic principles.

name	value	max_value	rationale
source_grounding	3.0	5.0	While Smith does discuss colonial policy and advocates for free trade over mercantilism in Book V, the entity appears to abstract his specific arguments into a generalized concept of "colony economic system principles" that may not reflect how Smith actually structured his analysis.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain placement is appropriate since Smith's colonial discussions in Book V focus heavily on regulatory frameworks, trade restrictions, and government policies affecting colonial commerce.

name	value	max_value	rationale
vsm_relevance	5.0	5.0	This entity maps clearly to S5 (identity/policy) as it deals with fundamental principles and policy frameworks that define how colonial economic systems should operate, representing the highest level of systemic identity and purpose.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity provides limited explanatory power, functioning more as a broad umbrella term than illuminating specific mechanisms or structural relations that Smith identifies in colonial economic arrangements.

Evaluation: Colony Economic System Principles

definition_precision — 2.0 / 5.0

The definition is vague and circular, essentially saying "principles that underlie colonial economic arrangements should be based on principles of natural liberty." It doesn't clearly distinguish what makes these principles specifically about colonies versus general economic principles.

source_grounding — 3.0 / 5.0

While Smith does discuss colonial policy and advocates for free trade over mercantilism in Book V, the entity appears to abstract his specific arguments into a generalized concept of "colony economic system principles" that may not reflect how Smith actually structured his analysis.

domain_placement — 4.0 / 5.0

The "Regulation" domain placement is appropriate since Smith's colonial discussions in Book V focus heavily on regulatory frameworks, trade restrictions, and government policies affecting colonial commerce.

vsm_relevance — 5.0 / 5.0

This entity maps clearly to S5 (identity/policy) as it deals with fundamental principles and policy frameworks that define how colonial economic systems should operate, representing the highest level of systemic identity and purpose.

explanatory_value — 2.0 / 5.0

The entity provides limited explanatory power, functioning more as a broad umbrella term than illuminating specific mechanisms or structural relations that Smith identifies in colonial economic arrangements.

3.1 KiB Raw Blame History