Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

speculative_trade

null

2026-02-23T06:24:18.124329

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes speculative trade from regular established business through specific characteristics: rapid shifting between commodities/markets, anticipation-based decisions, and irregular returns. The contrast with established trade patterns makes this a well-bounded concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses the contrast between speculative and regular trade, including the conditions required for speculation (extensive commerce and market intelligence). The definition accurately reflects Smith's observations.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement as speculative trade is fundamentally about market transactions and trading mechanisms rather than production, distribution, or consumption. It represents a specific mode of commercial exchange behavior.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as speculative trade depends heavily on market intelligence and rapid adaptation to environmental changes. It also touches S1 as a form of operational activity, making it VSM-relevant rather than abstract.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural mechanism in Smith's economic theory—how different forms of trade operate under different information and risk conditions. It explains why certain trading behaviors emerge in developed commercial centers versus simpler markets.

Evaluation: Speculative Trade

definition_precision — 4.0 / 5.0

The definition clearly distinguishes speculative trade from regular established business through specific characteristics: rapid shifting between commodities/markets, anticipation-based decisions, and irregular returns. The contrast with established trade patterns makes this a well-bounded concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses the contrast between speculative and regular trade, including the conditions required for speculation (extensive commerce and market intelligence). The definition accurately reflects Smith's observations.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement as speculative trade is fundamentally about market transactions and trading mechanisms rather than production, distribution, or consumption. It represents a specific mode of commercial exchange behavior.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as speculative trade depends heavily on market intelligence and rapid adaptation to environmental changes. It also touches S1 as a form of operational activity, making it VSM-relevant rather than abstract.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural mechanism in Smith's economic theory—how different forms of trade operate under different information and risk conditions. It explains why certain trading behaviors emerge in developed commercial centers versus simpler markets.

3.5 KiB Raw Blame History