Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

carrying_trade

null

2026-02-23T04:42:04.384395

1.8

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails to capture any concept in a meaningful way.

name	value	max_value	rationale
source_grounding	2.0	5.0	While "carrying trade" is indeed a concept that appears in The Wealth of Nations (referring to trade where merchants transport goods between foreign countries), the complete absence of definition or context suggests poor extraction from the source material. The entity exists as a term but lacks substantive grounding.

name	value	max_value	rationale
domain_placement	3.0	5.0	The carrying trade is fundamentally an economic concept related to international commerce and trade patterns, so it would likely belong in an appropriate economic domain if properly developed. However, with no domain specified and no definitional content, proper placement cannot be confirmed.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	Carrying trade could potentially map to S1 (as a primary economic operation) or S4 (as part of environmental/market intelligence), but without any definition or context provided, its VSM relevance cannot be properly assessed. The concept has potential VSM applicability but is too underdeveloped to place.

name	value	max_value	rationale
explanatory_value	1.0	5.0	With no definition, context, or explanatory content, this entity provides zero explanatory value about economic mechanisms or structural relations. It exists merely as an empty label without illuminating any phenomena from Smith's work.

Evaluation: Carrying Trade

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess precision or distinctness. Without any definitional content, this entity fails to capture any concept in a meaningful way.

source_grounding — 2.0 / 5.0

While "carrying trade" is indeed a concept that appears in The Wealth of Nations (referring to trade where merchants transport goods between foreign countries), the complete absence of definition or context suggests poor extraction from the source material. The entity exists as a term but lacks substantive grounding.

domain_placement — 3.0 / 5.0

The carrying trade is fundamentally an economic concept related to international commerce and trade patterns, so it would likely belong in an appropriate economic domain if properly developed. However, with no domain specified and no definitional content, proper placement cannot be confirmed.

vsm_relevance — 2.0 / 5.0

Carrying trade could potentially map to S1 (as a primary economic operation) or S4 (as part of environmental/market intelligence), but without any definition or context provided, its VSM relevance cannot be properly assessed. The concept has potential VSM applicability but is too underdeveloped to place.

explanatory_value — 1.0 / 5.0

With no definition, context, or explanatory content, this entity provides zero explanatory value about economic mechanisms or structural relations. It exists merely as an empty label without illuminating any phenomena from Smith's work.

3.3 KiB Raw Blame History