Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.9 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

exclusive_company

null

2026-02-23T05:25:03.246975

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and clearly distinguishes exclusive companies from other commercial entities through their defining characteristics: chartered status, monopoly rights, and territorial/trade exclusivity. The examples provided (Dutch East India Company, French Mississippi Company) help clarify the concept's boundaries.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is strongly grounded in Smith's actual text, particularly Book IV, Chapter 7, where he extensively critiques exclusive companies and their monopolistic practices. The description accurately reflects Smith's specific arguments about merchant governance leading to military despotism and economic stagnation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain placement is highly appropriate, as exclusive companies represent a specific form of government-granted regulatory privilege that creates market distortions. This fits perfectly within Smith's broader analysis of how regulatory interventions affect economic outcomes.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Exclusive companies have some VSM relevance as they represent dysfunctional organizational structures that fail across multiple systems (poor S4 intelligence due to monopoly insulation, corrupted S5 identity through rent-seeking). However, they're primarily examples of failed market structures rather than viable systems themselves.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by illuminating the specific mechanisms through which monopoly privileges distort economic development—showing how chartered exclusivity leads to price manipulation, innovation suppression, and colonial oppression. It demonstrates a clear causal structure in Smith's economic theory.

Evaluation: Exclusive Company

definition_precision — 4.0 / 5.0

The definition is precise and clearly distinguishes exclusive companies from other commercial entities through their defining characteristics: chartered status, monopoly rights, and territorial/trade exclusivity. The examples provided (Dutch East India Company, French Mississippi Company) help clarify the concept's boundaries.

source_grounding — 5.0 / 5.0

This entity is strongly grounded in Smith's actual text, particularly Book IV, Chapter 7, where he extensively critiques exclusive companies and their monopolistic practices. The description accurately reflects Smith's specific arguments about merchant governance leading to military despotism and economic stagnation.

domain_placement — 5.0 / 5.0

The "Regulation" domain placement is highly appropriate, as exclusive companies represent a specific form of government-granted regulatory privilege that creates market distortions. This fits perfectly within Smith's broader analysis of how regulatory interventions affect economic outcomes.

vsm_relevance — 3.0 / 5.0

Exclusive companies have some VSM relevance as they represent dysfunctional organizational structures that fail across multiple systems (poor S4 intelligence due to monopoly insulation, corrupted S5 identity through rent-seeking). However, they're primarily examples of failed market structures rather than viable systems themselves.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by illuminating the specific mechanisms through which monopoly privileges distort economic development—showing how chartered exclusivity leads to price manipulation, innovation suppression, and colonial oppression. It demonstrates a clear causal structure in Smith's economic theory.

3.9 KiB Raw Blame History