feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: monopoly_of_tobacco_trade
evaluator: null
evaluated_at: '2026-02-23T05:55:48.850468'
overall_score: 1.8
scores:
- name: definition_precision
value: 1.0
max_value: 5.0
rationale: There is no definition provided at all, making it impossible to assess
the precision or distinctness of the concept. Without a definition, this entity
lacks the basic conceptual clarity needed for meaningful analysis.
- name: source_grounding
value: 2.0
max_value: 5.0
rationale: While Smith does discuss tobacco trade and monopolies in "The Wealth
of Nations," the lack of chapter specification and context makes it unclear whether
this specific framing as "monopoly of tobacco trade" accurately reflects Smith's
treatment. The entity appears to reference legitimate source material but lacks
proper grounding documentation.
- name: domain_placement
value: 3.0
max_value: 5.0
rationale: The concept of tobacco trade monopolies would naturally fit within Smith's
discussions of mercantilism, colonial trade restrictions, and market distortions.
However, without domain specification or context, it's difficult to confirm appropriate
categorical placement within the broader economic framework.
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: A tobacco trade monopoly could potentially map to S1 (as a specific operational
system) or S3 (as a regulatory mechanism), but the complete lack of definition
and context makes VSM placement speculative. The entity is too underdeveloped
to establish clear systemic relevance.
- name: explanatory_value
value: 1.0
max_value: 5.0
rationale: Without definition, context, or source grounding, this entity provides
no explanatory power regarding economic mechanisms or structural relations. It
appears to merely name a phenomenon without illuminating how it functions within
Smith's analytical framework.
---
# Evaluation: Monopoly Of Tobacco Trade
## definition_precision — 1.0 / 5.0
There is no definition provided at all, making it impossible to assess the precision or distinctness of the concept. Without a definition, this entity lacks the basic conceptual clarity needed for meaningful analysis.
## source_grounding — 2.0 / 5.0
While Smith does discuss tobacco trade and monopolies in "The Wealth of Nations," the lack of chapter specification and context makes it unclear whether this specific framing as "monopoly of tobacco trade" accurately reflects Smith's treatment. The entity appears to reference legitimate source material but lacks proper grounding documentation.
## domain_placement — 3.0 / 5.0
The concept of tobacco trade monopolies would naturally fit within Smith's discussions of mercantilism, colonial trade restrictions, and market distortions. However, without domain specification or context, it's difficult to confirm appropriate categorical placement within the broader economic framework.
## vsm_relevance — 2.0 / 5.0
A tobacco trade monopoly could potentially map to S1 (as a specific operational system) or S3 (as a regulatory mechanism), but the complete lack of definition and context makes VSM placement speculative. The entity is too underdeveloped to establish clear systemic relevance.
## explanatory_value — 1.0 / 5.0
Without definition, context, or source grounding, this entity provides no explanatory power regarding economic mechanisms or structural relations. It appears to merely name a phenomenon without illuminating how it functions within Smith's analytical framework.