Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colony_economic_system_innovation

null

2026-02-23T04:54:36.238206

3.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a reasonably distinct concept about economic innovation in colonial settings, but it remains somewhat broad and could encompass almost any economic change in colonies. The phrase "new economic practices, technologies, and organizational forms" is quite general and doesn't clearly distinguish this from general economic development.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss colonial economies in Book V, Chapter 3, the specific framing of "innovation" as a distinct analytical category driven by "unique opportunities and challenges" appears to impose modern innovation theory concepts onto Smith's text. Smith's discussion focuses more on the effects of colonial policy and trade regulations than on innovation as a systematic process.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Accumulation" domain is appropriate since colonial economic development relates directly to capital formation and wealth creation. Smith's analysis of colonies fits well within his broader framework of how nations accumulate wealth through trade and productive activity.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how colonial economies adapt to new environmental conditions and opportunities. It could also relate to S1 (primary operations) in terms of developing new productive capabilities in colonial settings.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity primarily labels a phenomenon rather than explaining underlying mechanisms or structural relations. It doesn't illuminate why colonial conditions specifically drive innovation or how this process works, making it more descriptive than analytically powerful within Smith's framework.

Evaluation: Colony Economic System Innovation

definition_precision — 3.0 / 5.0

The definition captures a reasonably distinct concept about economic innovation in colonial settings, but it remains somewhat broad and could encompass almost any economic change in colonies. The phrase "new economic practices, technologies, and organizational forms" is quite general and doesn't clearly distinguish this from general economic development.

source_grounding — 2.0 / 5.0

While Smith does discuss colonial economies in Book V, Chapter 3, the specific framing of "innovation" as a distinct analytical category driven by "unique opportunities and challenges" appears to impose modern innovation theory concepts onto Smith's text. Smith's discussion focuses more on the effects of colonial policy and trade regulations than on innovation as a systematic process.

domain_placement — 4.0 / 5.0

The "Accumulation" domain is appropriate since colonial economic development relates directly to capital formation and wealth creation. Smith's analysis of colonies fits well within his broader framework of how nations accumulate wealth through trade and productive activity.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how colonial economies adapt to new environmental conditions and opportunities. It could also relate to S1 (primary operations) in terms of developing new productive capabilities in colonial settings.

explanatory_value — 2.0 / 5.0

The entity primarily labels a phenomenon rather than explaining underlying mechanisms or structural relations. It doesn't illuminate why colonial conditions specifically drive innovation or how this process works, making it more descriptive than analytically powerful within Smith's framework.

3.9 KiB Raw Blame History