Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

competition_among_dealers

null

2026-02-23T05:01:28.280123

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes competition among dealers as a specific force that creates a price floor (dealers won't accept less than market price) while ensuring price acceptance at market levels. It avoids circularity and captures a distinct regulatory mechanism rather than general competitive behavior.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 7, with the exact quoted phrase "obliges them all to accept of this price, but does not oblige them to accept of less." The concept represents Smith's actual analysis of how dealer competition functions in price regulation.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate since this concept deals specifically with the mechanics of how prices are determined and accepted in market transactions. It's fundamentally about the exchange process rather than production, distribution, or consumption.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This maps well to S2 (coordination/anti-oscillation) as it describes a mechanism that prevents price oscillations below natural levels and coordinates market behavior among dealers. It could also relate to S3 as an internal market regulation mechanism.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial structural mechanism in Smith's price theory—how competition creates asymmetric pressure that establishes price floors while allowing market clearing. It explains the specific dynamics of how natural price equilibrium is maintained from the supply side.

Evaluation: Competition Among Dealers

definition_precision — 4.0 / 5.0

The definition clearly distinguishes competition among dealers as a specific force that creates a price floor (dealers won't accept less than market price) while ensuring price acceptance at market levels. It avoids circularity and captures a distinct regulatory mechanism rather than general competitive behavior.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 7, with the exact quoted phrase "obliges them all to accept of this price, but does not oblige them to accept of less." The concept represents Smith's actual analysis of how dealer competition functions in price regulation.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate since this concept deals specifically with the mechanics of how prices are determined and accepted in market transactions. It's fundamentally about the exchange process rather than production, distribution, or consumption.

vsm_relevance — 4.0 / 5.0

This maps well to S2 (coordination/anti-oscillation) as it describes a mechanism that prevents price oscillations below natural levels and coordinates market behavior among dealers. It could also relate to S3 as an internal market regulation mechanism.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial structural mechanism in Smith's price theory—how competition creates asymmetric pressure that establishes price floors while allowing market clearing. It explains the specific dynamics of how natural price equilibrium is maintained from the supply side.

3.5 KiB Raw Blame History