feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,67 @@
|
||||
---
|
||||
entity_slug: colonial_economic_system_principles
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T04:49:56.898085'
|
||||
overall_score: 2.6
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 2.0
|
||||
max_value: 5.0
|
||||
rationale: The definition is quite vague and umbrella-like, combining disparate
|
||||
concepts (natural economic liberty, comparative advantage, open trade) without
|
||||
clearly delineating what specifically constitutes these "principles" as a coherent
|
||||
system. It reads more like a general summary of Smith's economic philosophy than
|
||||
a precise, distinct concept.
|
||||
- name: source_grounding
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: While Smith does discuss natural liberty and free trade in Book IV, Chapter
|
||||
7, the entity packages these ideas into a formal "Colonial Economic System Principles"
|
||||
framework that Smith doesn't explicitly present as a unified system. The individual
|
||||
components exist in the source, but their organization into this particular conceptual
|
||||
entity appears imposed rather than extracted.
|
||||
- name: domain_placement
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: '"General Theory" is an appropriate domain placement since this entity
|
||||
attempts to capture overarching theoretical principles rather than specific mechanisms
|
||||
or applications. The concepts described do operate at the level of fundamental
|
||||
economic theory rather than particular policy instruments.'
|
||||
- name: vsm_relevance
|
||||
value: 2.0
|
||||
max_value: 5.0
|
||||
rationale: This entity is too abstract and principle-oriented to map naturally to
|
||||
any specific VSM system - it's more like meta-guidance that could theoretically
|
||||
inform multiple systems rather than representing operational, coordinative, or
|
||||
regulatory functions. The principles described are VSM-neutral philosophical foundations
|
||||
rather than systemic mechanisms.
|
||||
- name: explanatory_value
|
||||
value: 2.0
|
||||
max_value: 5.0
|
||||
rationale: The entity primarily names and groups together well-known Smithian concepts
|
||||
without illuminating new mechanisms or structural relationships. It functions
|
||||
more as a categorical label than as an explanation of how these principles actually
|
||||
operate or interact within colonial economic systems.
|
||||
---
|
||||
|
||||
# Evaluation: Colonial Economic System Principles
|
||||
|
||||
## definition_precision — 2.0 / 5.0
|
||||
|
||||
The definition is quite vague and umbrella-like, combining disparate concepts (natural economic liberty, comparative advantage, open trade) without clearly delineating what specifically constitutes these "principles" as a coherent system. It reads more like a general summary of Smith's economic philosophy than a precise, distinct concept.
|
||||
|
||||
## source_grounding — 3.0 / 5.0
|
||||
|
||||
While Smith does discuss natural liberty and free trade in Book IV, Chapter 7, the entity packages these ideas into a formal "Colonial Economic System Principles" framework that Smith doesn't explicitly present as a unified system. The individual components exist in the source, but their organization into this particular conceptual entity appears imposed rather than extracted.
|
||||
|
||||
## domain_placement — 4.0 / 5.0
|
||||
|
||||
"General Theory" is an appropriate domain placement since this entity attempts to capture overarching theoretical principles rather than specific mechanisms or applications. The concepts described do operate at the level of fundamental economic theory rather than particular policy instruments.
|
||||
|
||||
## vsm_relevance — 2.0 / 5.0
|
||||
|
||||
This entity is too abstract and principle-oriented to map naturally to any specific VSM system - it's more like meta-guidance that could theoretically inform multiple systems rather than representing operational, coordinative, or regulatory functions. The principles described are VSM-neutral philosophical foundations rather than systemic mechanisms.
|
||||
|
||||
## explanatory_value — 2.0 / 5.0
|
||||
|
||||
The entity primarily names and groups together well-known Smithian concepts without illuminating new mechanisms or structural relationships. It functions more as a categorical label than as an explanation of how these principles actually operate or interact within colonial economic systems.
|
||||
Reference in New Issue
Block a user