Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic_system_principles

null

2026-02-23T04:49:56.898085

2.6

name	value	max_value	rationale
definition_precision	2.0	5.0	The definition is quite vague and umbrella-like, combining disparate concepts (natural economic liberty, comparative advantage, open trade) without clearly delineating what specifically constitutes these "principles" as a coherent system. It reads more like a general summary of Smith's economic philosophy than a precise, distinct concept.

name	value	max_value	rationale
source_grounding	3.0	5.0	While Smith does discuss natural liberty and free trade in Book IV, Chapter 7, the entity packages these ideas into a formal "Colonial Economic System Principles" framework that Smith doesn't explicitly present as a unified system. The individual components exist in the source, but their organization into this particular conceptual entity appears imposed rather than extracted.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is an appropriate domain placement since this entity attempts to capture overarching theoretical principles rather than specific mechanisms or applications. The concepts described do operate at the level of fundamental economic theory rather than particular policy instruments.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	This entity is too abstract and principle-oriented to map naturally to any specific VSM system - it's more like meta-guidance that could theoretically inform multiple systems rather than representing operational, coordinative, or regulatory functions. The principles described are VSM-neutral philosophical foundations rather than systemic mechanisms.

name	value	max_value	rationale
explanatory_value	2.0	5.0	The entity primarily names and groups together well-known Smithian concepts without illuminating new mechanisms or structural relationships. It functions more as a categorical label than as an explanation of how these principles actually operate or interact within colonial economic systems.

Evaluation: Colonial Economic System Principles

definition_precision — 2.0 / 5.0

The definition is quite vague and umbrella-like, combining disparate concepts (natural economic liberty, comparative advantage, open trade) without clearly delineating what specifically constitutes these "principles" as a coherent system. It reads more like a general summary of Smith's economic philosophy than a precise, distinct concept.

source_grounding — 3.0 / 5.0

While Smith does discuss natural liberty and free trade in Book IV, Chapter 7, the entity packages these ideas into a formal "Colonial Economic System Principles" framework that Smith doesn't explicitly present as a unified system. The individual components exist in the source, but their organization into this particular conceptual entity appears imposed rather than extracted.

domain_placement — 4.0 / 5.0

"General Theory" is an appropriate domain placement since this entity attempts to capture overarching theoretical principles rather than specific mechanisms or applications. The concepts described do operate at the level of fundamental economic theory rather than particular policy instruments.

vsm_relevance — 2.0 / 5.0

This entity is too abstract and principle-oriented to map naturally to any specific VSM system - it's more like meta-guidance that could theoretically inform multiple systems rather than representing operational, coordinative, or regulatory functions. The principles described are VSM-neutral philosophical foundations rather than systemic mechanisms.

explanatory_value — 2.0 / 5.0

The entity primarily names and groups together well-known Smithian concepts without illuminating new mechanisms or structural relationships. It functions more as a categorical label than as an explanation of how these principles actually operate or interact within colonial economic systems.

4.0 KiB Raw Blame History