feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,63 @@
|
||||
---
|
||||
entity_slug: subsistence_of_the_dealer
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T06:27:12.742891'
|
||||
overall_score: 4.0
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition is clear and precise, distinguishing the dealer's own
|
||||
maintenance needs from other business costs by drawing a specific analogy to worker
|
||||
wages. It captures a distinct economic concept rather than being vague or circular.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: The entity is directly grounded in Smith's text with an exact quotation
|
||||
provided, showing that Smith explicitly discussed this concept using the specific
|
||||
analogy between advancing wages to workers and advancing subsistence to oneself.
|
||||
- name: domain_placement
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: Placement in "Distribution" is appropriate since this concerns how economic
|
||||
value flows to support the dealer's livelihood as part of the broader distribution
|
||||
of economic returns. It could potentially fit in a "Production" domain but Distribution
|
||||
captures the essence well.
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: This maps reasonably to S1 (primary operations) as it represents a fundamental
|
||||
operational requirement for the dealer to function, though it's more of a constraint
|
||||
or prerequisite rather than a core VSM process. It's not strongly VSM-oriented
|
||||
but has some natural placement.
|
||||
- name: explanatory_value
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: "The entity illuminates an important structural relationship in Smith's\
|
||||
\ economic thinking\u2014that dealers must account for their own subsistence just\
|
||||
\ as they do for workers' wages, revealing the parallel treatment of different\
|
||||
\ types of economic actors. This adds genuine insight into the mechanics of market\
|
||||
\ operations."
|
||||
---
|
||||
|
||||
# Evaluation: Subsistence Of The Dealer
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition is clear and precise, distinguishing the dealer's own maintenance needs from other business costs by drawing a specific analogy to worker wages. It captures a distinct economic concept rather than being vague or circular.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
The entity is directly grounded in Smith's text with an exact quotation provided, showing that Smith explicitly discussed this concept using the specific analogy between advancing wages to workers and advancing subsistence to oneself.
|
||||
|
||||
## domain_placement — 4.0 / 5.0
|
||||
|
||||
Placement in "Distribution" is appropriate since this concerns how economic value flows to support the dealer's livelihood as part of the broader distribution of economic returns. It could potentially fit in a "Production" domain but Distribution captures the essence well.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
This maps reasonably to S1 (primary operations) as it represents a fundamental operational requirement for the dealer to function, though it's more of a constraint or prerequisite rather than a core VSM process. It's not strongly VSM-oriented but has some natural placement.
|
||||
|
||||
## explanatory_value — 4.0 / 5.0
|
||||
|
||||
The entity illuminates an important structural relationship in Smith's economic thinking—that dealers must account for their own subsistence just as they do for workers' wages, revealing the parallel treatment of different types of economic actors. This adds genuine insight into the mechanics of market operations.
|
||||
Reference in New Issue
Block a user