Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

retail_trade

null

2026-02-23T06:17:52.028736

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes retail trade from wholesale trade and captures the key insight about apparent profits being disguised wages. It's precise and non-circular, though could be slightly more specific about what constitutes "small quantities."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's analysis from Book I, Chapter 10, where he explicitly discusses how retail merchants' higher apparent profits largely represent compensation for additional labor and skill rather than pure capital returns. The concept faithfully represents Smith's actual argument.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for retail trade, as it represents a fundamental mechanism of market exchange between producers/wholesalers and final consumers. This is clearly an exchange process rather than production, distribution, or consumption per se.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	Retail trade maps well to S1 (primary operations) as it represents operational activities that directly interface with the environment (consumers), and potentially to S4 (intelligence) as retailers gather market information about consumer preferences. It has clear VSM relevance rather than being abstract.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating Smith's key insight that apparent profit differentials often mask labor compensation, revealing the underlying economic mechanism rather than just describing surface phenomena. It helps explain how market structures affect the distribution of returns between labor and capital.

Evaluation: Retail Trade

definition_precision — 4.0 / 5.0

The definition clearly distinguishes retail trade from wholesale trade and captures the key insight about apparent profits being disguised wages. It's precise and non-circular, though could be slightly more specific about what constitutes "small quantities."

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's analysis from Book I, Chapter 10, where he explicitly discusses how retail merchants' higher apparent profits largely represent compensation for additional labor and skill rather than pure capital returns. The concept faithfully represents Smith's actual argument.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for retail trade, as it represents a fundamental mechanism of market exchange between producers/wholesalers and final consumers. This is clearly an exchange process rather than production, distribution, or consumption per se.

vsm_relevance — 4.0 / 5.0

Retail trade maps well to S1 (primary operations) as it represents operational activities that directly interface with the environment (consumers), and potentially to S4 (intelligence) as retailers gather market information about consumer preferences. It has clear VSM relevance rather than being abstract.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating Smith's key insight that apparent profit differentials often mask labor compensation, revealing the underlying economic mechanism rather than just describing surface phenomena. It helps explain how market structures affect the distribution of returns between labor and capital.

3.6 KiB Raw Blame History