Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

smuggling_of_precious_metals

null

2026-02-23T06:22:05.093058

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct economic phenomenon with clear causal mechanisms (profit opportunities exceeding risks/costs driving illegal transport). It avoids circularity and specifies the conditions under which smuggling occurs rather than just describing the activity itself.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual argument from Book IV, Chapter 1, where he explicitly discusses how prohibitions on precious metal exports inevitably lead to smuggling. Smith uses this as a key example to demonstrate the futility of mercantile restrictions.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this concerns the movement of precious metals between markets and the mechanisms that govern international trade flows. The entity deals fundamentally with exchange rate arbitrage and market integration.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance as it represents a response mechanism (S1 operations) to regulatory constraints, and demonstrates how S4 intelligence (recognizing profit opportunities) drives adaptive behavior. However, it's more of a market phenomenon than a clear organizational system component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by illuminating Smith's key insight about how market forces inevitably circumvent artificial restrictions. It demonstrates the structural relationship between price differentials, regulatory constraints, and private incentives that drives much of Smith's critique of mercantilism.

Evaluation: Smuggling Of Precious Metals

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct economic phenomenon with clear causal mechanisms (profit opportunities exceeding risks/costs driving illegal transport). It avoids circularity and specifies the conditions under which smuggling occurs rather than just describing the activity itself.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual argument from Book IV, Chapter 1, where he explicitly discusses how prohibitions on precious metal exports inevitably lead to smuggling. Smith uses this as a key example to demonstrate the futility of mercantile restrictions.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this concerns the movement of precious metals between markets and the mechanisms that govern international trade flows. The entity deals fundamentally with exchange rate arbitrage and market integration.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance as it represents a response mechanism (S1 operations) to regulatory constraints, and demonstrates how S4 intelligence (recognizing profit opportunities) drives adaptive behavior. However, it's more of a market phenomenon than a clear organizational system component.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by illuminating Smith's key insight about how market forces inevitably circumvent artificial restrictions. It demonstrates the structural relationship between price differentials, regulatory constraints, and private incentives that drives much of Smith's critique of mercantilism.

3.6 KiB Raw Blame History