Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_equilibrium

null

2026-02-23T04:53:43.843593

2.6

name	value	max_value	rationale
definition_precision	2.0	5.0	The definition is vague and relies on undefined terms like "stable state," "naturally tend," and "balanced growth" without specifying what constitutes equilibrium or how it's measured. It reads more like a general economic principle than a precise, operationalizable concept.

name	value	max_value	rationale
source_grounding	3.0	5.0	While Smith does discuss colonial economies and their natural development, the specific framing of a "stable equilibrium state" with "balanced growth across sectors" appears to impose modern equilibrium theory concepts that may not reflect Smith's actual analytical framework. The general idea of natural development is present, but the equilibrium terminology seems anachronistic.

name	value	max_value	rationale
domain_placement	2.0	5.0	"Accumulation" seems like a poor fit for what is described as a systemic equilibrium state. This concept appears more related to systemic coordination or regulation rather than the process of capital accumulation per se.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to VSM System 3 (internal regulation) as it describes the self-regulating tendency of colonial economic systems to achieve balance. It could also relate to S2 (coordination) in terms of how different sectors coordinate naturally.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity names a phenomenon (tendency toward equilibrium) but doesn't illuminate the specific mechanisms by which colonial economies achieve this balance or what structural relations enable it. It remains at a high level of abstraction without explanatory depth.

Evaluation: Colony Economic System Equilibrium

definition_precision — 2.0 / 5.0

The definition is vague and relies on undefined terms like "stable state," "naturally tend," and "balanced growth" without specifying what constitutes equilibrium or how it's measured. It reads more like a general economic principle than a precise, operationalizable concept.

source_grounding — 3.0 / 5.0

While Smith does discuss colonial economies and their natural development, the specific framing of a "stable equilibrium state" with "balanced growth across sectors" appears to impose modern equilibrium theory concepts that may not reflect Smith's actual analytical framework. The general idea of natural development is present, but the equilibrium terminology seems anachronistic.

domain_placement — 2.0 / 5.0

"Accumulation" seems like a poor fit for what is described as a systemic equilibrium state. This concept appears more related to systemic coordination or regulation rather than the process of capital accumulation per se.

vsm_relevance — 4.0 / 5.0

This entity maps well to VSM System 3 (internal regulation) as it describes the self-regulating tendency of colonial economic systems to achieve balance. It could also relate to S2 (coordination) in terms of how different sectors coordinate naturally.

explanatory_value — 2.0 / 5.0

The entity names a phenomenon (tendency toward equilibrium) but doesn't illuminate the specific mechanisms by which colonial economies achieve this balance or what structural relations enable it. It remains at a high level of abstraction without explanatory depth.

3.5 KiB Raw Blame History