feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,66 @@
---
entity_slug: colony_economic_system_innovation
evaluator: null
evaluated_at: '2026-02-23T04:54:36.238206'
overall_score: 3.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a reasonably distinct concept about economic
innovation in colonial settings, but it remains somewhat broad and could encompass
almost any economic change in colonies. The phrase "new economic practices, technologies,
and organizational forms" is quite general and doesn't clearly distinguish this
from general economic development.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss colonial economies in Book V, Chapter 3, the
specific framing of "innovation" as a distinct analytical category driven by "unique
opportunities and challenges" appears to impose modern innovation theory concepts
onto Smith's text. Smith's discussion focuses more on the effects of colonial
policy and trade regulations than on innovation as a systematic process.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: The "Accumulation" domain is appropriate since colonial economic development
relates directly to capital formation and wealth creation. Smith's analysis of
colonies fits well within his broader framework of how nations accumulate wealth
through trade and productive activity.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it describes how colonial economies adapt to new environmental conditions and
opportunities. It could also relate to S1 (primary operations) in terms of developing
new productive capabilities in colonial settings.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity primarily labels a phenomenon rather than explaining underlying
mechanisms or structural relations. It doesn't illuminate why colonial conditions
specifically drive innovation or how this process works, making it more descriptive
than analytically powerful within Smith's framework.
---
# Evaluation: Colony Economic System Innovation
## definition_precision — 3.0 / 5.0
The definition captures a reasonably distinct concept about economic innovation in colonial settings, but it remains somewhat broad and could encompass almost any economic change in colonies. The phrase "new economic practices, technologies, and organizational forms" is quite general and doesn't clearly distinguish this from general economic development.
## source_grounding — 2.0 / 5.0
While Smith does discuss colonial economies in Book V, Chapter 3, the specific framing of "innovation" as a distinct analytical category driven by "unique opportunities and challenges" appears to impose modern innovation theory concepts onto Smith's text. Smith's discussion focuses more on the effects of colonial policy and trade regulations than on innovation as a systematic process.
## domain_placement — 4.0 / 5.0
The "Accumulation" domain is appropriate since colonial economic development relates directly to capital formation and wealth creation. Smith's analysis of colonies fits well within his broader framework of how nations accumulate wealth through trade and productive activity.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it describes how colonial economies adapt to new environmental conditions and opportunities. It could also relate to S1 (primary operations) in terms of developing new productive capabilities in colonial settings.
## explanatory_value — 2.0 / 5.0
The entity primarily labels a phenomenon rather than explaining underlying mechanisms or structural relations. It doesn't illuminate why colonial conditions specifically drive innovation or how this process works, making it more descriptive than analytically powerful within Smith's framework.