feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: competition_among_buyers
evaluator: null
evaluated_at: '2026-02-23T05:01:19.546921'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies competition among buyers as a specific
market mechanism triggered when supply falls short of effectual demand, leading
to price increases. It's precise and non-circular, though it could be slightly
more detailed about the competitive dynamics involved.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
7, with the exact quote provided showing Smith's description of how buyer competition
emerges when quantity is insufficient. The concept is explicitly stated rather
than inferred.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since this describes a
fundamental mechanism of market exchange where buyers compete for scarce goods.
This is a core aspect of how markets function in the exchange process.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S2 (coordination)
as it describes how markets self-regulate through competitive mechanisms, or S1
as an operational market process. However, it's primarily a market mechanism rather
than a clear organizational system component.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides strong explanatory value by illuminating a specific
causal mechanism that drives price movements above natural levels. It explains
how market forces operate when demand exceeds supply, making it more than just
a surface phenomenon label.
---
# Evaluation: Competition Among Buyers
## definition_precision — 4.0 / 5.0
The definition clearly identifies competition among buyers as a specific market mechanism triggered when supply falls short of effectual demand, leading to price increases. It's precise and non-circular, though it could be slightly more detailed about the competitive dynamics involved.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book I, Chapter 7, with the exact quote provided showing Smith's description of how buyer competition emerges when quantity is insufficient. The concept is explicitly stated rather than inferred.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since this describes a fundamental mechanism of market exchange where buyers compete for scarce goods. This is a core aspect of how markets function in the exchange process.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S2 (coordination) as it describes how markets self-regulate through competitive mechanisms, or S1 as an operational market process. However, it's primarily a market mechanism rather than a clear organizational system component.
## explanatory_value — 4.0 / 5.0
This entity provides strong explanatory value by illuminating a specific causal mechanism that drives price movements above natural levels. It explains how market forces operate when demand exceeds supply, making it more than just a surface phenomenon label.