Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

agricultural_price_discovery

null

2026-02-23T00:29:25.484525

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly describes a specific market mechanism - how prices are established through buyer-seller interactions that incorporate supply, demand, and cost information. It avoids circularity and distinguishes this process from general price-setting by emphasizing the information aggregation function.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith extensively discusses agricultural markets and price formation in Book I, Chapter 11, including how natural market processes establish prices and how government interference disrupts these mechanisms. The concept of price discovery as an information-processing function aligns well with Smith's analysis of market coordination.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement since price discovery is fundamentally about the exchange process itself - how trading interactions generate price information. This is distinct from production or consumption domains.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as price discovery serves as a coordination mechanism that prevents market oscillations by efficiently aggregating and transmitting information. It also has some S4 (intelligence) aspects in how it processes environmental information about supply and demand conditions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates a crucial market mechanism - how decentralized trading generates the price signals that coordinate economic activity. It explains the structural process by which individual transactions aggregate into market-wide information, which is fundamental to understanding market efficiency.

Evaluation: Agricultural Price Discovery

definition_precision — 4.0 / 5.0

The definition clearly describes a specific market mechanism - how prices are established through buyer-seller interactions that incorporate supply, demand, and cost information. It avoids circularity and distinguishes this process from general price-setting by emphasizing the information aggregation function.

source_grounding — 4.0 / 5.0

Smith extensively discusses agricultural markets and price formation in Book I, Chapter 11, including how natural market processes establish prices and how government interference disrupts these mechanisms. The concept of price discovery as an information-processing function aligns well with Smith's analysis of market coordination.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement since price discovery is fundamentally about the exchange process itself - how trading interactions generate price information. This is distinct from production or consumption domains.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as price discovery serves as a coordination mechanism that prevents market oscillations by efficiently aggregating and transmitting information. It also has some S4 (intelligence) aspects in how it processes environmental information about supply and demand conditions.

explanatory_value — 4.0 / 5.0

The entity illuminates a crucial market mechanism - how decentralized trading generates the price signals that coordinate economic activity. It explains the structural process by which individual transactions aggregate into market-wide information, which is fundamental to understanding market efficiency.

3.7 KiB Raw Blame History