Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_system_dynamics

null

2026-02-23T04:48:12.012301

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about economic change patterns in colonies, but uses somewhat vague terms like "patterns of change" and "adjustment processes" that could be more precisely specified. The connection to policy design adds clarity but doesn't fully resolve the conceptual boundaries.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity appears well-grounded in Smith's actual analysis of colonial development in Book IV, Chapter 7, where he does examine how colonial economies develop over time and how monopoly policies interfere with natural growth patterns. The framing aligns with Smith's systematic approach to understanding economic development trajectories.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate since this entity deals with broad patterns of economic development rather than specific mechanisms or institutions. The concept spans multiple aspects of colonial economics and represents a higher-level analytical framework consistent with theoretical domain placement.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too abstract and meta-analytical to map naturally to specific VSM systems - it describes patterns across systems rather than functioning within them. While colonial economies themselves could be analyzed through VSM, the concept of "dynamics" sits above the operational level where VSM systems function.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The entity provides moderate explanatory value by highlighting that colonial development follows predictable patterns that can inform policy, but it remains somewhat descriptive rather than revealing deep causal mechanisms. It identifies an important analytical perspective without fully illuminating the underlying structural relations that drive these dynamics.

Evaluation: Colonial Economic System Dynamics

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about economic change patterns in colonies, but uses somewhat vague terms like "patterns of change" and "adjustment processes" that could be more precisely specified. The connection to policy design adds clarity but doesn't fully resolve the conceptual boundaries.

source_grounding — 4.0 / 5.0

This entity appears well-grounded in Smith's actual analysis of colonial development in Book IV, Chapter 7, where he does examine how colonial economies develop over time and how monopoly policies interfere with natural growth patterns. The framing aligns with Smith's systematic approach to understanding economic development trajectories.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate since this entity deals with broad patterns of economic development rather than specific mechanisms or institutions. The concept spans multiple aspects of colonial economics and represents a higher-level analytical framework consistent with theoretical domain placement.

vsm_relevance — 2.0 / 5.0

This entity is too abstract and meta-analytical to map naturally to specific VSM systems - it describes patterns across systems rather than functioning within them. While colonial economies themselves could be analyzed through VSM, the concept of "dynamics" sits above the operational level where VSM systems function.

explanatory_value — 3.0 / 5.0

The entity provides moderate explanatory value by highlighting that colonial development follows predictable patterns that can inform policy, but it remains somewhat descriptive rather than revealing deep causal mechanisms. It identifies an important analytical perspective without fully illuminating the underlying structural relations that drive these dynamics.

4.0 KiB Raw Blame History