feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: smuggling_of_precious_metals
evaluator: null
evaluated_at: '2026-02-23T06:22:05.093058'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is precise and captures a distinct economic phenomenon
with clear causal mechanisms (profit opportunities exceeding risks/costs driving
illegal transport). It avoids circularity and specifies the conditions under which
smuggling occurs rather than just describing the activity itself.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's actual argument from Book
IV, Chapter 1, where he explicitly discusses how prohibitions on precious metal
exports inevitably lead to smuggling. Smith uses this as a key example to demonstrate
the futility of mercantile restrictions.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since this concerns the
movement of precious metals between markets and the mechanisms that govern international
trade flows. The entity deals fundamentally with exchange rate arbitrage and market
integration.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance as it represents a response mechanism
(S1 operations) to regulatory constraints, and demonstrates how S4 intelligence
(recognizing profit opportunities) drives adaptive behavior. However, it's more
of a market phenomenon than a clear organizational system component.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory value by illuminating Smith's
key insight about how market forces inevitably circumvent artificial restrictions.
It demonstrates the structural relationship between price differentials, regulatory
constraints, and private incentives that drives much of Smith's critique of mercantilism.
---
# Evaluation: Smuggling Of Precious Metals
## definition_precision — 4.0 / 5.0
The definition is precise and captures a distinct economic phenomenon with clear causal mechanisms (profit opportunities exceeding risks/costs driving illegal transport). It avoids circularity and specifies the conditions under which smuggling occurs rather than just describing the activity itself.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's actual argument from Book IV, Chapter 1, where he explicitly discusses how prohibitions on precious metal exports inevitably lead to smuggling. Smith uses this as a key example to demonstrate the futility of mercantile restrictions.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since this concerns the movement of precious metals between markets and the mechanisms that govern international trade flows. The entity deals fundamentally with exchange rate arbitrage and market integration.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance as it represents a response mechanism (S1 operations) to regulatory constraints, and demonstrates how S4 intelligence (recognizing profit opportunities) drives adaptive behavior. However, it's more of a market phenomenon than a clear organizational system component.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory value by illuminating Smith's key insight about how market forces inevitably circumvent artificial restrictions. It demonstrates the structural relationship between price differentials, regulatory constraints, and private incentives that drives much of Smith's critique of mercantilism.