Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

masquerade_dress_trade

null

2026-02-23T05:49:22.556826

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is quite precise, clearly distinguishing masquerade dress rental as a specific case where consumption goods function as capital through rental arrangements. It avoids circularity and captures a distinct economic mechanism rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity appears to be directly grounded in Smith's actual example from Book II, Chapter 1, where he discusses how goods normally meant for consumption can occasionally serve as capital when rented out. The masquerade dress example is one of Smith's concrete illustrations of this principle.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain placement is highly appropriate, as this entity fundamentally concerns the commercial exchange of temporary use rights for revenue. It sits at the intersection of consumption and capital formation through market mechanisms.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity maps most naturally to S1 (primary operations) as a specific business practice, but it's somewhat VSM-neutral since it describes a particular market activity rather than a systemic function. It doesn't clearly illuminate broader organizational or regulatory mechanisms.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory value by illustrating the fluid boundary between consumption goods and capital, showing how the same physical object can serve different economic functions depending on its use. It illuminates an important mechanism in Smith's theory of capital formation.

Evaluation: Masquerade Dress Trade

definition_precision — 4.0 / 5.0

The definition is quite precise, clearly distinguishing masquerade dress rental as a specific case where consumption goods function as capital through rental arrangements. It avoids circularity and captures a distinct economic mechanism rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity appears to be directly grounded in Smith's actual example from Book II, Chapter 1, where he discusses how goods normally meant for consumption can occasionally serve as capital when rented out. The masquerade dress example is one of Smith's concrete illustrations of this principle.

domain_placement — 5.0 / 5.0

The "Exchange" domain placement is highly appropriate, as this entity fundamentally concerns the commercial exchange of temporary use rights for revenue. It sits at the intersection of consumption and capital formation through market mechanisms.

vsm_relevance — 3.0 / 5.0

This entity maps most naturally to S1 (primary operations) as a specific business practice, but it's somewhat VSM-neutral since it describes a particular market activity rather than a systemic function. It doesn't clearly illuminate broader organizational or regulatory mechanisms.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory value by illustrating the fluid boundary between consumption goods and capital, showing how the same physical object can serve different economic functions depending on its use. It illuminates an important mechanism in Smith's theory of capital formation.

3.4 KiB Raw Blame History