feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: masquerade_dress_trade
evaluator: null
evaluated_at: '2026-02-23T05:49:22.556826'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is quite precise, clearly distinguishing masquerade dress
rental as a specific case where consumption goods function as capital through
rental arrangements. It avoids circularity and captures a distinct economic mechanism
rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity appears to be directly grounded in Smith's actual example
from Book II, Chapter 1, where he discusses how goods normally meant for consumption
can occasionally serve as capital when rented out. The masquerade dress example
is one of Smith's concrete illustrations of this principle.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain placement is highly appropriate, as this entity
fundamentally concerns the commercial exchange of temporary use rights for revenue.
It sits at the intersection of consumption and capital formation through market
mechanisms.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity maps most naturally to S1 (primary operations) as a specific
business practice, but it's somewhat VSM-neutral since it describes a particular
market activity rather than a systemic function. It doesn't clearly illuminate
broader organizational or regulatory mechanisms.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides genuine explanatory value by illustrating the fluid
boundary between consumption goods and capital, showing how the same physical
object can serve different economic functions depending on its use. It illuminates
an important mechanism in Smith's theory of capital formation.
---
# Evaluation: Masquerade Dress Trade
## definition_precision — 4.0 / 5.0
The definition is quite precise, clearly distinguishing masquerade dress rental as a specific case where consumption goods function as capital through rental arrangements. It avoids circularity and captures a distinct economic mechanism rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity appears to be directly grounded in Smith's actual example from Book II, Chapter 1, where he discusses how goods normally meant for consumption can occasionally serve as capital when rented out. The masquerade dress example is one of Smith's concrete illustrations of this principle.
## domain_placement — 5.0 / 5.0
The "Exchange" domain placement is highly appropriate, as this entity fundamentally concerns the commercial exchange of temporary use rights for revenue. It sits at the intersection of consumption and capital formation through market mechanisms.
## vsm_relevance — 3.0 / 5.0
This entity maps most naturally to S1 (primary operations) as a specific business practice, but it's somewhat VSM-neutral since it describes a particular market activity rather than a systemic function. It doesn't clearly illuminate broader organizational or regulatory mechanisms.
## explanatory_value — 4.0 / 5.0
This entity provides genuine explanatory value by illustrating the fluid boundary between consumption goods and capital, showing how the same physical object can serve different economic functions depending on its use. It illuminates an important mechanism in Smith's theory of capital formation.