feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,63 @@
---
entity_slug: subsistence_of_the_dealer
evaluator: null
evaluated_at: '2026-02-23T06:27:12.742891'
overall_score: 4.0
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is clear and precise, distinguishing the dealer's own
maintenance needs from other business costs by drawing a specific analogy to worker
wages. It captures a distinct economic concept rather than being vague or circular.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: The entity is directly grounded in Smith's text with an exact quotation
provided, showing that Smith explicitly discussed this concept using the specific
analogy between advancing wages to workers and advancing subsistence to oneself.
- name: domain_placement
value: 4.0
max_value: 5.0
rationale: Placement in "Distribution" is appropriate since this concerns how economic
value flows to support the dealer's livelihood as part of the broader distribution
of economic returns. It could potentially fit in a "Production" domain but Distribution
captures the essence well.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This maps reasonably to S1 (primary operations) as it represents a fundamental
operational requirement for the dealer to function, though it's more of a constraint
or prerequisite rather than a core VSM process. It's not strongly VSM-oriented
but has some natural placement.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: "The entity illuminates an important structural relationship in Smith's\
\ economic thinking\u2014that dealers must account for their own subsistence just\
\ as they do for workers' wages, revealing the parallel treatment of different\
\ types of economic actors. This adds genuine insight into the mechanics of market\
\ operations."
---
# Evaluation: Subsistence Of The Dealer
## definition_precision — 4.0 / 5.0
The definition is clear and precise, distinguishing the dealer's own maintenance needs from other business costs by drawing a specific analogy to worker wages. It captures a distinct economic concept rather than being vague or circular.
## source_grounding — 5.0 / 5.0
The entity is directly grounded in Smith's text with an exact quotation provided, showing that Smith explicitly discussed this concept using the specific analogy between advancing wages to workers and advancing subsistence to oneself.
## domain_placement — 4.0 / 5.0
Placement in "Distribution" is appropriate since this concerns how economic value flows to support the dealer's livelihood as part of the broader distribution of economic returns. It could potentially fit in a "Production" domain but Distribution captures the essence well.
## vsm_relevance — 3.0 / 5.0
This maps reasonably to S1 (primary operations) as it represents a fundamental operational requirement for the dealer to function, though it's more of a constraint or prerequisite rather than a core VSM process. It's not strongly VSM-oriented but has some natural placement.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important structural relationship in Smith's economic thinking—that dealers must account for their own subsistence just as they do for workers' wages, revealing the parallel treatment of different types of economic actors. This adds genuine insight into the mechanics of market operations.