Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_justice

null

2026-02-23T04:46:26.227916

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept around fairness in colonial economic arrangements, but relies on somewhat vague terms like "fairness" and "equal treatment" without precise criteria. It does distinguish itself from mere economic efficiency by focusing specifically on justice and equity considerations.

name	value	max_value	rationale
source_grounding	4.0	5.0	This entity is well-grounded in Smith's actual arguments in Book IV, Chapter 7, where he explicitly critiques the injustice of colonial arrangements that burden the mother country while restricting colonial freedom. The context accurately reflects Smith's position that current arrangements lack justice and his advocacy for more equitable economic freedom.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Regulation" domain is appropriate since colonial economic justice involves the rules, laws, and institutional arrangements governing colonial trade relationships. This is fundamentally about regulatory frameworks rather than pure market operations or individual behavior.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too abstract and normative to map clearly to specific VSM systems - it's more of a meta-criterion for evaluating arrangements across multiple systems rather than a functional component itself. While it might inform S5 (policy/identity) considerations, it doesn't represent a distinct operational or regulatory mechanism.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The entity provides moderate explanatory value by highlighting Smith's normative framework for evaluating colonial arrangements, but it's more descriptive of desired outcomes than explanatory of underlying economic mechanisms. It helps understand Smith's critique but doesn't illuminate specific causal relationships or structural dynamics.

Evaluation: Colonial Economic Justice

definition_precision — 3.0 / 5.0

The definition captures a coherent concept around fairness in colonial economic arrangements, but relies on somewhat vague terms like "fairness" and "equal treatment" without precise criteria. It does distinguish itself from mere economic efficiency by focusing specifically on justice and equity considerations.

source_grounding — 4.0 / 5.0

This entity is well-grounded in Smith's actual arguments in Book IV, Chapter 7, where he explicitly critiques the injustice of colonial arrangements that burden the mother country while restricting colonial freedom. The context accurately reflects Smith's position that current arrangements lack justice and his advocacy for more equitable economic freedom.

domain_placement — 4.0 / 5.0

The "Regulation" domain is appropriate since colonial economic justice involves the rules, laws, and institutional arrangements governing colonial trade relationships. This is fundamentally about regulatory frameworks rather than pure market operations or individual behavior.

vsm_relevance — 2.0 / 5.0

This entity is too abstract and normative to map clearly to specific VSM systems - it's more of a meta-criterion for evaluating arrangements across multiple systems rather than a functional component itself. While it might inform S5 (policy/identity) considerations, it doesn't represent a distinct operational or regulatory mechanism.

explanatory_value — 3.0 / 5.0

The entity provides moderate explanatory value by highlighting Smith's normative framework for evaluating colonial arrangements, but it's more descriptive of desired outcomes than explanatory of underlying economic mechanisms. It helps understand Smith's critique but doesn't illuminate specific causal relationships or structural dynamics.

3.9 KiB Raw Blame History