feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: trade_balance_mechanism
evaluator: null
evaluated_at: '2026-02-23T06:32:59.111794'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly describes a specific automatic adjustment mechanism
involving exchange rates, prices, and precious metal flows to balance trade. It
avoids circularity and captures a distinct economic process rather than a vague
concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's analysis in Book IV, Chapter
1, where he explicitly discusses how trade imbalances self-correct through natural
market mechanisms without government intervention. The description accurately
reflects Smith's argument about automatic adjustment processes.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate for this entity, as it
deals with international trade flows, currency adjustments, and the mechanisms
that govern trade relationships between nations. This is fundamentally about exchange
processes.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S2 (coordination/anti-oscillation) as it describes
a natural regulatory mechanism that prevents trade imbalances from becoming extreme,
and also connects to S3 (internal regulation) through its automatic adjustment
function. It represents a clear cybernetic control mechanism.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides substantial explanatory power by illuminating the
specific mechanism through which Smith argues markets self-regulate international
trade without government intervention. It reveals the structural logic underlying
Smith's critique of mercantilist trade policies.
---
# Evaluation: Trade Balance Mechanism
## definition_precision — 4.0 / 5.0
The definition clearly describes a specific automatic adjustment mechanism involving exchange rates, prices, and precious metal flows to balance trade. It avoids circularity and captures a distinct economic process rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's analysis in Book IV, Chapter 1, where he explicitly discusses how trade imbalances self-correct through natural market mechanisms without government intervention. The description accurately reflects Smith's argument about automatic adjustment processes.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate for this entity, as it deals with international trade flows, currency adjustments, and the mechanisms that govern trade relationships between nations. This is fundamentally about exchange processes.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S2 (coordination/anti-oscillation) as it describes a natural regulatory mechanism that prevents trade imbalances from becoming extreme, and also connects to S3 (internal regulation) through its automatic adjustment function. It represents a clear cybernetic control mechanism.
## explanatory_value — 5.0 / 5.0
This entity provides substantial explanatory power by illuminating the specific mechanism through which Smith argues markets self-regulate international trade without government intervention. It reveals the structural logic underlying Smith's critique of mercantilist trade policies.