Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

monopoly_of_tobacco_trade

null

2026-02-23T05:55:48.850468

1.8

name	value	max_value	rationale
definition_precision	1.0	5.0	There is no definition provided at all, making it impossible to assess the precision or distinctness of the concept. Without a definition, this entity lacks the basic conceptual clarity needed for meaningful analysis.

name	value	max_value	rationale
source_grounding	2.0	5.0	While Smith does discuss tobacco trade and monopolies in "The Wealth of Nations," the lack of chapter specification and context makes it unclear whether this specific framing as "monopoly of tobacco trade" accurately reflects Smith's treatment. The entity appears to reference legitimate source material but lacks proper grounding documentation.

name	value	max_value	rationale
domain_placement	3.0	5.0	The concept of tobacco trade monopolies would naturally fit within Smith's discussions of mercantilism, colonial trade restrictions, and market distortions. However, without domain specification or context, it's difficult to confirm appropriate categorical placement within the broader economic framework.

name	value	max_value	rationale
vsm_relevance	2.0	5.0	A tobacco trade monopoly could potentially map to S1 (as a specific operational system) or S3 (as a regulatory mechanism), but the complete lack of definition and context makes VSM placement speculative. The entity is too underdeveloped to establish clear systemic relevance.

name	value	max_value	rationale
explanatory_value	1.0	5.0	Without definition, context, or source grounding, this entity provides no explanatory power regarding economic mechanisms or structural relations. It appears to merely name a phenomenon without illuminating how it functions within Smith's analytical framework.

Evaluation: Monopoly Of Tobacco Trade

definition_precision — 1.0 / 5.0

There is no definition provided at all, making it impossible to assess the precision or distinctness of the concept. Without a definition, this entity lacks the basic conceptual clarity needed for meaningful analysis.

source_grounding — 2.0 / 5.0

While Smith does discuss tobacco trade and monopolies in "The Wealth of Nations," the lack of chapter specification and context makes it unclear whether this specific framing as "monopoly of tobacco trade" accurately reflects Smith's treatment. The entity appears to reference legitimate source material but lacks proper grounding documentation.

domain_placement — 3.0 / 5.0

The concept of tobacco trade monopolies would naturally fit within Smith's discussions of mercantilism, colonial trade restrictions, and market distortions. However, without domain specification or context, it's difficult to confirm appropriate categorical placement within the broader economic framework.

vsm_relevance — 2.0 / 5.0

A tobacco trade monopoly could potentially map to S1 (as a specific operational system) or S3 (as a regulatory mechanism), but the complete lack of definition and context makes VSM placement speculative. The entity is too underdeveloped to establish clear systemic relevance.

explanatory_value — 1.0 / 5.0

Without definition, context, or source grounding, this entity provides no explanatory power regarding economic mechanisms or structural relations. It appears to merely name a phenomenon without illuminating how it functions within Smith's analytical framework.

3.5 KiB Raw Blame History