Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

colonial_economic

null

2026-02-23T04:49:13.410679

1.8

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making this entity completely imprecise. "Colonial Economic" appears to be an incomplete phrase that could refer to colonial economic systems, policies, or relationships, but without definition it captures nothing distinct.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss colonial trade and economic relationships in "The Wealth of Nations," this entity lacks any specified source chapter or context to demonstrate actual grounding in the text. The incomplete phrasing suggests it may not reflect Smith's actual terminology or conceptual framework.

name	value	max_value	rationale
domain_placement	3.0	5.0	If this refers to colonial economic matters, it would reasonably belong in an economic domain, but the unspecified domain and incomplete entity name make proper categorization impossible. The economic nature is plausible but unconfirmed.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Colonial economic relationships could potentially map to S4 (environmental intelligence about distant markets) or S1 (operational trade activities), but the undefined nature of this entity makes VSM placement speculative at best. The incomplete concept provides no clear systemic function.

name	value	max_value	rationale
explanatory_value	1.0	5.0	An undefined, incomplete entity provides zero explanatory value about economic mechanisms or structural relations. It merely presents an incomplete label without illuminating any aspect of Smith's analysis of colonial economic dynamics.

Evaluation: Colonial Economic

definition_precision — 1.0 / 5.0

There is no definition provided at all, making this entity completely imprecise. "Colonial Economic" appears to be an incomplete phrase that could refer to colonial economic systems, policies, or relationships, but without definition it captures nothing distinct.

source_grounding — 2.0 / 5.0

While Smith does discuss colonial trade and economic relationships in "The Wealth of Nations," this entity lacks any specified source chapter or context to demonstrate actual grounding in the text. The incomplete phrasing suggests it may not reflect Smith's actual terminology or conceptual framework.

domain_placement — 3.0 / 5.0

If this refers to colonial economic matters, it would reasonably belong in an economic domain, but the unspecified domain and incomplete entity name make proper categorization impossible. The economic nature is plausible but unconfirmed.

vsm_relevance — 2.0 / 5.0

Colonial economic relationships could potentially map to S4 (environmental intelligence about distant markets) or S1 (operational trade activities), but the undefined nature of this entity makes VSM placement speculative at best. The incomplete concept provides no clear systemic function.

explanatory_value — 1.0 / 5.0

An undefined, incomplete entity provides zero explanatory value about economic mechanisms or structural relations. It merely presents an incomplete label without illuminating any aspect of Smith's analysis of colonial economic dynamics.

3.3 KiB Raw Blame History