Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

commercial_regulations

null

2026-02-23T04:59:23.667648

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and clearly distinguishes commercial regulations from natural market mechanisms, specifying concrete examples (tariffs, quotas, prohibitions, licensing) and their political rather than economic rationale. It avoids circularity by defining the concept through its mechanism and purpose rather than just restating the term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's extensive critique of mercantile system interventions throughout Book IV, particularly Chapter 8's systematic examination of trade restrictions. Smith explicitly analyzes how these regulations substitute "political wisdom" for market forces and produce unintended consequences.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain is precisely correct, as commercial regulations represent the primary regulatory mechanism by which governments attempt to control trade flows. This clearly distinguishes it from pure market phenomena or institutional structures.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Commercial regulations map somewhat awkwardly to VSM systems as they represent external constraints on the economic system rather than internal cybernetic functions. They might relate to S3 (internal regulation) by analogy, but they're actually external political impositions that disrupt rather than enable viable system operation.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory power by illuminating the key mechanism through which the mercantile system attempts to manage economic activity and why such interventions systematically fail. It reveals the structural tension between political direction and market coordination that is central to Smith's critique.

Evaluation: Commercial Regulations

definition_precision — 4.0 / 5.0

The definition is precise and clearly distinguishes commercial regulations from natural market mechanisms, specifying concrete examples (tariffs, quotas, prohibitions, licensing) and their political rather than economic rationale. It avoids circularity by defining the concept through its mechanism and purpose rather than just restating the term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's extensive critique of mercantile system interventions throughout Book IV, particularly Chapter 8's systematic examination of trade restrictions. Smith explicitly analyzes how these regulations substitute "political wisdom" for market forces and produce unintended consequences.

domain_placement — 5.0 / 5.0

The "Regulation" domain is precisely correct, as commercial regulations represent the primary regulatory mechanism by which governments attempt to control trade flows. This clearly distinguishes it from pure market phenomena or institutional structures.

vsm_relevance — 3.0 / 5.0

Commercial regulations map somewhat awkwardly to VSM systems as they represent external constraints on the economic system rather than internal cybernetic functions. They might relate to S3 (internal regulation) by analogy, but they're actually external political impositions that disrupt rather than enable viable system operation.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory power by illuminating the key mechanism through which the mercantile system attempts to manage economic activity and why such interventions systematically fail. It reveals the structural tension between political direction and market coordination that is central to Smith's critique.

3.8 KiB Raw Blame History