Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

perfect_liberty_in_trade

null

2026-02-23T06:05:09.242715

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly specifying the ability of dealers to change trades without restriction and linking this to price gravitational effects. It captures a distinct economic condition rather than being vague or circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 7, where he explicitly discusses the conditions under which market prices approach natural prices. The concept of "perfect liberty" is Smith's own terminology for this unrestricted trading condition.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is exactly correct, as this concept fundamentally concerns the absence of regulatory restrictions on trade. It represents the baseline condition against which various forms of market regulation can be measured.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S2 (coordination) as it describes conditions that prevent market oscillations and distortions. However, it's somewhat abstract as it describes an ideal state rather than an active regulatory mechanism.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by identifying the foundational condition necessary for Smith's price theory to operate. It illuminates the structural relationship between regulatory freedom and market price mechanisms, making it essential for understanding how natural prices emerge.

Evaluation: Perfect Liberty In Trade

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly specifying the ability of dealers to change trades without restriction and linking this to price gravitational effects. It captures a distinct economic condition rather than being vague or circular.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 7, where he explicitly discusses the conditions under which market prices approach natural prices. The concept of "perfect liberty" is Smith's own terminology for this unrestricted trading condition.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is exactly correct, as this concept fundamentally concerns the absence of regulatory restrictions on trade. It represents the baseline condition against which various forms of market regulation can be measured.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S2 (coordination) as it describes conditions that prevent market oscillations and distortions. However, it's somewhat abstract as it describes an ideal state rather than an active regulatory mechanism.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by identifying the foundational condition necessary for Smith's price theory to operate. It illuminates the structural relationship between regulatory freedom and market price mechanisms, making it essential for understanding how natural prices emerge.

3.3 KiB Raw Blame History