Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

forestalling

null

2026-02-23T05:30:34.958824

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies forestalling as buying goods before they reach market with intent to resell at higher prices, specifically mentioning corn and historical legal prohibitions. The concept is distinct and well-bounded, though it could be slightly more precise about the timing aspect ("before they reach market").

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual discussion in Book IV, Chapter 5, where he explicitly addresses forestalling laws and argues against their effectiveness. The context accurately reflects Smith's position that such prohibitions are misguided and that merchants provide valuable services through this practice.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain placement is entirely appropriate, as forestalling is fundamentally about market transactions, pricing mechanisms, and the flow of goods between producers and consumers. This fits perfectly within exchange-related economic concepts.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Forestalling maps well to S4 (intelligence/environmental adaptation) as it involves merchants anticipating future market conditions and scarcity, and potentially to S2 (coordination) as it helps distribute goods more efficiently across time and space. The practice demonstrates clear systemic functions within market operations.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important mechanism in Smith's thinking about market efficiency and the unintended beneficial consequences of seemingly self-interested behavior. It demonstrates how practices that appear manipulative can actually serve coordinating functions in economic systems.

Evaluation: Forestalling

definition_precision — 4.0 / 5.0

The definition clearly identifies forestalling as buying goods before they reach market with intent to resell at higher prices, specifically mentioning corn and historical legal prohibitions. The concept is distinct and well-bounded, though it could be slightly more precise about the timing aspect ("before they reach market").

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual discussion in Book IV, Chapter 5, where he explicitly addresses forestalling laws and argues against their effectiveness. The context accurately reflects Smith's position that such prohibitions are misguided and that merchants provide valuable services through this practice.

domain_placement — 5.0 / 5.0

The "Exchange" domain placement is entirely appropriate, as forestalling is fundamentally about market transactions, pricing mechanisms, and the flow of goods between producers and consumers. This fits perfectly within exchange-related economic concepts.

vsm_relevance — 4.0 / 5.0

Forestalling maps well to S4 (intelligence/environmental adaptation) as it involves merchants anticipating future market conditions and scarcity, and potentially to S2 (coordination) as it helps distribute goods more efficiently across time and space. The practice demonstrates clear systemic functions within market operations.

explanatory_value — 4.0 / 5.0

This entity illuminates an important mechanism in Smith's thinking about market efficiency and the unintended beneficial consequences of seemingly self-interested behavior. It demonstrates how practices that appear manipulative can actually serve coordinating functions in economic systems.

3.7 KiB Raw Blame History