feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: perfect_liberty_in_trade
evaluator: null
evaluated_at: '2026-02-23T06:05:09.242715'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is quite precise, clearly specifying the ability of dealers
to change trades without restriction and linking this to price gravitational effects.
It captures a distinct economic condition rather than being vague or circular.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
7, where he explicitly discusses the conditions under which market prices approach
natural prices. The concept of "perfect liberty" is Smith's own terminology for
this unrestricted trading condition.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Regulation" domain assignment is exactly correct, as this concept
fundamentally concerns the absence of regulatory restrictions on trade. It represents
the baseline condition against which various forms of market regulation can be
measured.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S2 (coordination)
as it describes conditions that prevent market oscillations and distortions. However,
it's somewhat abstract as it describes an ideal state rather than an active regulatory
mechanism.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory value by identifying the foundational
condition necessary for Smith's price theory to operate. It illuminates the structural
relationship between regulatory freedom and market price mechanisms, making it
essential for understanding how natural prices emerge.
---
# Evaluation: Perfect Liberty In Trade
## definition_precision — 4.0 / 5.0
The definition is quite precise, clearly specifying the ability of dealers to change trades without restriction and linking this to price gravitational effects. It captures a distinct economic condition rather than being vague or circular.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book I, Chapter 7, where he explicitly discusses the conditions under which market prices approach natural prices. The concept of "perfect liberty" is Smith's own terminology for this unrestricted trading condition.
## domain_placement — 5.0 / 5.0
The "Regulation" domain assignment is exactly correct, as this concept fundamentally concerns the absence of regulatory restrictions on trade. It represents the baseline condition against which various forms of market regulation can be measured.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S2 (coordination) as it describes conditions that prevent market oscillations and distortions. However, it's somewhat abstract as it describes an ideal state rather than an active regulatory mechanism.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory value by identifying the foundational condition necessary for Smith's price theory to operate. It illuminates the structural relationship between regulatory freedom and market price mechanisms, making it essential for understanding how natural prices emerge.