Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

4.0 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

joint_stock_company

null

2026-02-23T05:38:48.224232

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly captures the essential features of joint-stock companies - multiple shareholders contributing capital and sharing profits/losses, often with government privileges. It's precise and non-circular, though could be slightly more specific about the transferability of shares that distinguishes joint-stock from other partnership forms.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text, specifically his analysis in Book IV, Chapter 5 of the white herring fishery joint-stock company as an example of inefficient capital allocation due to government bounties. Smith extensively discusses joint-stock companies throughout the work as concrete organizational forms.

name	value	max_value	rationale
domain_placement	4.0	5.0	"General Theory" is appropriate as joint-stock companies represent a fundamental organizational structure that Smith analyzes across multiple contexts - from trade monopolies to public works. However, it could arguably fit in a more specific domain like "Business Organization" or "Market Structure" if those existed.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Joint-stock companies have moderate VSM relevance as organizational structures that must coordinate shareholders (S2), regulate internal operations (S3), and adapt to market conditions (S4). However, as a structural form rather than a functional process, the VSM mapping is not as natural as it would be for operational mechanisms.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by illuminating Smith's key mechanism about how organizational forms interact with government privileges to create inefficient capital allocation. It's not merely naming a phenomenon but explaining a structural relationship central to Smith's critique of mercantilism.

Evaluation: Joint Stock Company

definition_precision — 4.0 / 5.0

The definition clearly captures the essential features of joint-stock companies - multiple shareholders contributing capital and sharing profits/losses, often with government privileges. It's precise and non-circular, though could be slightly more specific about the transferability of shares that distinguishes joint-stock from other partnership forms.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text, specifically his analysis in Book IV, Chapter 5 of the white herring fishery joint-stock company as an example of inefficient capital allocation due to government bounties. Smith extensively discusses joint-stock companies throughout the work as concrete organizational forms.

domain_placement — 4.0 / 5.0

"General Theory" is appropriate as joint-stock companies represent a fundamental organizational structure that Smith analyzes across multiple contexts - from trade monopolies to public works. However, it could arguably fit in a more specific domain like "Business Organization" or "Market Structure" if those existed.

vsm_relevance — 3.0 / 5.0

Joint-stock companies have moderate VSM relevance as organizational structures that must coordinate shareholders (S2), regulate internal operations (S3), and adapt to market conditions (S4). However, as a structural form rather than a functional process, the VSM mapping is not as natural as it would be for operational mechanisms.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by illuminating Smith's key mechanism about how organizational forms interact with government privileges to create inefficient capital allocation. It's not merely naming a phenomenon but explaining a structural relationship central to Smith's critique of mercantilism.

4.0 KiB Raw Blame History