Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

butcher_trade

null

2026-02-23T04:39:31.512860

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is precise and captures a distinct concept - the specific trade of slaughtering and selling meat with its characteristic of being disagreeable yet profitable. It avoids circularity and clearly distinguishes this trade from other commercial activities.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses the butcher trade as an example of disagreeable employment that commands higher profits. The characterization as "brutal and odious" reflects Smith's actual language and analysis.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Distribution" domain placement is appropriate since this concerns how profits are distributed across different trades based on their characteristics. It could potentially fit in a labor/employment domain, but distribution captures the profit allocation aspect Smith emphasizes.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps most naturally to S1 (primary operations) as a specific economic activity, but it also has S4 relevance in demonstrating how market intelligence about trade desirability affects profit distribution. However, it's primarily an example rather than a systemic mechanism.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illustrating Smith's principle that disagreeable trades earn compensating differentials - a key mechanism in how market forces distribute profits. It's not merely descriptive but demonstrates an important structural economic relation.

Evaluation: Butcher Trade

definition_precision — 4.0 / 5.0

The definition is precise and captures a distinct concept - the specific trade of slaughtering and selling meat with its characteristic of being disagreeable yet profitable. It avoids circularity and clearly distinguishes this trade from other commercial activities.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses the butcher trade as an example of disagreeable employment that commands higher profits. The characterization as "brutal and odious" reflects Smith's actual language and analysis.

domain_placement — 4.0 / 5.0

The "Distribution" domain placement is appropriate since this concerns how profits are distributed across different trades based on their characteristics. It could potentially fit in a labor/employment domain, but distribution captures the profit allocation aspect Smith emphasizes.

vsm_relevance — 3.0 / 5.0

This entity maps most naturally to S1 (primary operations) as a specific economic activity, but it also has S4 relevance in demonstrating how market intelligence about trade desirability affects profit distribution. However, it's primarily an example rather than a systemic mechanism.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illustrating Smith's principle that disagreeable trades earn compensating differentials - a key mechanism in how market forces distribute profits. It's not merely descriptive but demonstrates an important structural economic relation.

3.5 KiB Raw Blame History