feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,67 @@
---
entity_slug: colonial_economic_system_principles
evaluator: null
evaluated_at: '2026-02-23T04:49:56.898085'
overall_score: 2.6
scores:
- name: definition_precision
value: 2.0
max_value: 5.0
rationale: The definition is quite vague and umbrella-like, combining disparate
concepts (natural economic liberty, comparative advantage, open trade) without
clearly delineating what specifically constitutes these "principles" as a coherent
system. It reads more like a general summary of Smith's economic philosophy than
a precise, distinct concept.
- name: source_grounding
value: 3.0
max_value: 5.0
rationale: While Smith does discuss natural liberty and free trade in Book IV, Chapter
7, the entity packages these ideas into a formal "Colonial Economic System Principles"
framework that Smith doesn't explicitly present as a unified system. The individual
components exist in the source, but their organization into this particular conceptual
entity appears imposed rather than extracted.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: '"General Theory" is an appropriate domain placement since this entity
attempts to capture overarching theoretical principles rather than specific mechanisms
or applications. The concepts described do operate at the level of fundamental
economic theory rather than particular policy instruments.'
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity is too abstract and principle-oriented to map naturally to
any specific VSM system - it's more like meta-guidance that could theoretically
inform multiple systems rather than representing operational, coordinative, or
regulatory functions. The principles described are VSM-neutral philosophical foundations
rather than systemic mechanisms.
- name: explanatory_value
value: 2.0
max_value: 5.0
rationale: The entity primarily names and groups together well-known Smithian concepts
without illuminating new mechanisms or structural relationships. It functions
more as a categorical label than as an explanation of how these principles actually
operate or interact within colonial economic systems.
---
# Evaluation: Colonial Economic System Principles
## definition_precision — 2.0 / 5.0
The definition is quite vague and umbrella-like, combining disparate concepts (natural economic liberty, comparative advantage, open trade) without clearly delineating what specifically constitutes these "principles" as a coherent system. It reads more like a general summary of Smith's economic philosophy than a precise, distinct concept.
## source_grounding — 3.0 / 5.0
While Smith does discuss natural liberty and free trade in Book IV, Chapter 7, the entity packages these ideas into a formal "Colonial Economic System Principles" framework that Smith doesn't explicitly present as a unified system. The individual components exist in the source, but their organization into this particular conceptual entity appears imposed rather than extracted.
## domain_placement — 4.0 / 5.0
"General Theory" is an appropriate domain placement since this entity attempts to capture overarching theoretical principles rather than specific mechanisms or applications. The concepts described do operate at the level of fundamental economic theory rather than particular policy instruments.
## vsm_relevance — 2.0 / 5.0
This entity is too abstract and principle-oriented to map naturally to any specific VSM system - it's more like meta-guidance that could theoretically inform multiple systems rather than representing operational, coordinative, or regulatory functions. The principles described are VSM-neutral philosophical foundations rather than systemic mechanisms.
## explanatory_value — 2.0 / 5.0
The entity primarily names and groups together well-known Smithian concepts without illuminating new mechanisms or structural relationships. It functions more as a categorical label than as an explanation of how these principles actually operate or interact within colonial economic systems.