Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_evolution

null

2026-02-23T04:54:01.727708

3.2

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a coherent concept about colonial economic development over time, but uses somewhat vague terms like "predictable patterns" and "various stages" without specifying what these actually entail. It's non-circular but could be more precise about the specific transformations involved.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does indeed discuss colonial economic development in Book V, Chapter 3, tracing how colonies evolve from initial settlements to more sophisticated economic systems. The entity accurately reflects his analysis of colonial economic progression, though it generalizes his observations into a broader evolutionary framework.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placement in the "Accumulation" domain is appropriate since colonial economic evolution fundamentally concerns how wealth and capital accumulate and transform over time in colonial contexts. This aligns well with Smith's broader themes about economic development and capital formation.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too abstract and historical to map clearly to specific VSM systems - it describes a meta-process of systemic change rather than operational functions. While it might relate to S4 (adaptation) in a very general sense, it doesn't naturally fit the VSM framework's operational focus.

name	value	max_value	rationale
explanatory_value	3.0	5.0	The entity provides moderate explanatory value by highlighting that colonial economies follow developmental patterns rather than being static, but it remains somewhat descriptive rather than revealing specific causal mechanisms. It names an important phenomenon but doesn't deeply illuminate the underlying structural relations driving the evolution.

Evaluation: Colony Economic System Evolution

definition_precision — 3.0 / 5.0

The definition captures a coherent concept about colonial economic development over time, but uses somewhat vague terms like "predictable patterns" and "various stages" without specifying what these actually entail. It's non-circular but could be more precise about the specific transformations involved.

source_grounding — 4.0 / 5.0

Smith does indeed discuss colonial economic development in Book V, Chapter 3, tracing how colonies evolve from initial settlements to more sophisticated economic systems. The entity accurately reflects his analysis of colonial economic progression, though it generalizes his observations into a broader evolutionary framework.

domain_placement — 4.0 / 5.0

Placement in the "Accumulation" domain is appropriate since colonial economic evolution fundamentally concerns how wealth and capital accumulate and transform over time in colonial contexts. This aligns well with Smith's broader themes about economic development and capital formation.

vsm_relevance — 2.0 / 5.0

This entity is too abstract and historical to map clearly to specific VSM systems - it describes a meta-process of systemic change rather than operational functions. While it might relate to S4 (adaptation) in a very general sense, it doesn't naturally fit the VSM framework's operational focus.

explanatory_value — 3.0 / 5.0

The entity provides moderate explanatory value by highlighting that colonial economies follow developmental patterns rather than being static, but it remains somewhat descriptive rather than revealing specific causal mechanisms. It names an important phenomenon but doesn't deeply illuminate the underlying structural relations driving the evolution.

3.8 KiB Raw Blame History