Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

competition_among_sellers

null

2026-02-23T05:01:36.700535

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a specific market mechanism - the competitive response of sellers when supply exceeds demand. It clearly distinguishes this from other forms of competition by focusing on the excess inventory disposal scenario.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 7, which explicitly discusses how competition among sellers increases when quantity exceeds effectual demand. The concept and language align closely with Smith's actual analysis of market price dynamics.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate as this entity describes a fundamental mechanism within market transactions. Competition among sellers is a core component of how exchange processes function and prices are determined.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S2 (coordination) as it represents a self-regulating mechanism that prevents price oscillations from persisting. However, it could also be viewed as part of S1 operations or as VSM-neutral market dynamics.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by illuminating a specific causal mechanism in price formation - how seller rivalry under excess supply conditions drives market prices below natural prices. It explains the "how" of market adjustment, not just the "what."

Evaluation: Competition Among Sellers

definition_precision — 4.0 / 5.0

The definition is precise and captures a specific market mechanism - the competitive response of sellers when supply exceeds demand. It clearly distinguishes this from other forms of competition by focusing on the excess inventory disposal scenario.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 7, which explicitly discusses how competition among sellers increases when quantity exceeds effectual demand. The concept and language align closely with Smith's actual analysis of market price dynamics.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate as this entity describes a fundamental mechanism within market transactions. Competition among sellers is a core component of how exchange processes function and prices are determined.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S2 (coordination) as it represents a self-regulating mechanism that prevents price oscillations from persisting. However, it could also be viewed as part of S1 operations or as VSM-neutral market dynamics.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by illuminating a specific causal mechanism in price formation - how seller rivalry under excess supply conditions drives market prices below natural prices. It explains the "how" of market adjustment, not just the "what."

3.3 KiB Raw Blame History