Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bounty

null

2026-02-23T04:38:48.435116

4.8

name	value	max_value	rationale
definition_precision	5.0	5.0	The definition is highly precise, clearly distinguishing bounties as government subsidies specifically for exportation that compensate for below-cost selling. It avoids circularity and captures a distinct economic mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book IV, Chapter 5, where Smith extensively analyzes bounties as a key instrument of the mercantile system. The definition and context accurately reflect Smith's detailed critique of export bounties.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is correct, as bounties represent a specific form of government intervention in markets. This fits perfectly within Smith's broader analysis of regulatory mechanisms and their economic effects.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Bounties map well to S3 (internal regulation) as they represent government attempts to control and direct economic activity, and potentially S4 (intelligence/adaptation) as responses to competitive pressures. The regulatory nature gives it clear VSM relevance.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating a specific mechanism through which governments attempt to manipulate trade flows and competitive advantage. It reveals the structural relationship between state intervention and market distortion that Smith critiques.

Evaluation: Bounty

definition_precision — 5.0 / 5.0

The definition is highly precise, clearly distinguishing bounties as government subsidies specifically for exportation that compensate for below-cost selling. It avoids circularity and captures a distinct economic mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book IV, Chapter 5, where Smith extensively analyzes bounties as a key instrument of the mercantile system. The definition and context accurately reflect Smith's detailed critique of export bounties.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is correct, as bounties represent a specific form of government intervention in markets. This fits perfectly within Smith's broader analysis of regulatory mechanisms and their economic effects.

vsm_relevance — 4.0 / 5.0

Bounties map well to S3 (internal regulation) as they represent government attempts to control and direct economic activity, and potentially S4 (intelligence/adaptation) as responses to competitive pressures. The regulatory nature gives it clear VSM relevance.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating a specific mechanism through which governments attempt to manipulate trade flows and competitive advantage. It reveals the structural relationship between state intervention and market distortion that Smith critiques.

3.2 KiB Raw Blame History