Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_system_sustainability

null

2026-02-23T04:50:24.574577

3.8

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a reasonably distinct concept about long-term viability of colonial systems, but uses somewhat vague terms like "unsustainable dependencies" and "more open systems" without precise specification. The contrast between monopoly and open arrangements provides some clarity but could be more operationally defined.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual arguments from Book IV, Chapter 7, where he explicitly critiques monopoly-based colonial systems as creating inefficiencies and argues for more open arrangements. The characterization accurately reflects Smith's position on colonial economic policy sustainability.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as this entity addresses broad principles about economic system design and sustainability that extend beyond specific colonial contexts. It represents a theoretical insight about institutional arrangements rather than a narrow empirical observation.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 4 (intelligence/environmental adaptation) as it concerns how colonial systems adapt to changing conditions and maintain viability over time. It also touches on System 5 (identity/policy) regarding fundamental organizational design choices between monopoly and open approaches.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural mechanism in Smith's theory—how institutional design (monopoly vs. openness) affects long-term system viability through feedback effects on efficiency and political stability. This provides genuine insight into the dynamics of economic system sustainability rather than merely labeling a phenomenon.

Evaluation: Colonial Economic System Sustainability

definition_precision — 3.0 / 5.0

The definition captures a reasonably distinct concept about long-term viability of colonial systems, but uses somewhat vague terms like "unsustainable dependencies" and "more open systems" without precise specification. The contrast between monopoly and open arrangements provides some clarity but could be more operationally defined.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual arguments from Book IV, Chapter 7, where he explicitly critiques monopoly-based colonial systems as creating inefficiencies and argues for more open arrangements. The characterization accurately reflects Smith's position on colonial economic policy sustainability.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as this entity addresses broad principles about economic system design and sustainability that extend beyond specific colonial contexts. It represents a theoretical insight about institutional arrangements rather than a narrow empirical observation.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 4 (intelligence/environmental adaptation) as it concerns how colonial systems adapt to changing conditions and maintain viability over time. It also touches on System 5 (identity/policy) regarding fundamental organizational design choices between monopoly and open approaches.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural mechanism in Smith's theory—how institutional design (monopoly vs. openness) affects long-term system viability through feedback effects on efficiency and political stability. This provides genuine insight into the dynamics of economic system sustainability rather than merely labeling a phenomenon.

3.9 KiB Raw Blame History