Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

competition_among_buyers

null

2026-02-23T05:01:19.546921

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies competition among buyers as a specific market mechanism triggered when supply falls short of effectual demand, leading to price increases. It's precise and non-circular, though it could be slightly more detailed about the competitive dynamics involved.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 7, with the exact quote provided showing Smith's description of how buyer competition emerges when quantity is insufficient. The concept is explicitly stated rather than inferred.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this describes a fundamental mechanism of market exchange where buyers compete for scarce goods. This is a core aspect of how markets function in the exchange process.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S2 (coordination) as it describes how markets self-regulate through competitive mechanisms, or S1 as an operational market process. However, it's primarily a market mechanism rather than a clear organizational system component.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides strong explanatory value by illuminating a specific causal mechanism that drives price movements above natural levels. It explains how market forces operate when demand exceeds supply, making it more than just a surface phenomenon label.

Evaluation: Competition Among Buyers

definition_precision — 4.0 / 5.0

The definition clearly identifies competition among buyers as a specific market mechanism triggered when supply falls short of effectual demand, leading to price increases. It's precise and non-circular, though it could be slightly more detailed about the competitive dynamics involved.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 7, with the exact quote provided showing Smith's description of how buyer competition emerges when quantity is insufficient. The concept is explicitly stated rather than inferred.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this describes a fundamental mechanism of market exchange where buyers compete for scarce goods. This is a core aspect of how markets function in the exchange process.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S2 (coordination) as it describes how markets self-regulate through competitive mechanisms, or S1 as an operational market process. However, it's primarily a market mechanism rather than a clear organizational system component.

explanatory_value — 4.0 / 5.0

This entity provides strong explanatory value by illuminating a specific causal mechanism that drives price movements above natural levels. It explains how market forces operate when demand exceeds supply, making it more than just a surface phenomenon label.

3.3 KiB Raw Blame History