Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

subsistence_of_the_dealer

null

2026-02-23T06:27:12.742891

4.0

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition is clear and precise, distinguishing the dealer's own maintenance needs from other business costs by drawing a specific analogy to worker wages. It captures a distinct economic concept rather than being vague or circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	The entity is directly grounded in Smith's text with an exact quotation provided, showing that Smith explicitly discussed this concept using the specific analogy between advancing wages to workers and advancing subsistence to oneself.

name	value	max_value	rationale
domain_placement	4.0	5.0	Placement in "Distribution" is appropriate since this concerns how economic value flows to support the dealer's livelihood as part of the broader distribution of economic returns. It could potentially fit in a "Production" domain but Distribution captures the essence well.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This maps reasonably to S1 (primary operations) as it represents a fundamental operational requirement for the dealer to function, though it's more of a constraint or prerequisite rather than a core VSM process. It's not strongly VSM-oriented but has some natural placement.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important structural relationship in Smith's economic thinking—that dealers must account for their own subsistence just as they do for workers' wages, revealing the parallel treatment of different types of economic actors. This adds genuine insight into the mechanics of market operations.

Evaluation: Subsistence Of The Dealer

definition_precision — 4.0 / 5.0

The definition is clear and precise, distinguishing the dealer's own maintenance needs from other business costs by drawing a specific analogy to worker wages. It captures a distinct economic concept rather than being vague or circular.

source_grounding — 5.0 / 5.0

The entity is directly grounded in Smith's text with an exact quotation provided, showing that Smith explicitly discussed this concept using the specific analogy between advancing wages to workers and advancing subsistence to oneself.

domain_placement — 4.0 / 5.0

Placement in "Distribution" is appropriate since this concerns how economic value flows to support the dealer's livelihood as part of the broader distribution of economic returns. It could potentially fit in a "Production" domain but Distribution captures the essence well.

vsm_relevance — 3.0 / 5.0

This maps reasonably to S1 (primary operations) as it represents a fundamental operational requirement for the dealer to function, though it's more of a constraint or prerequisite rather than a core VSM process. It's not strongly VSM-oriented but has some natural placement.

explanatory_value — 4.0 / 5.0

The entity illuminates an important structural relationship in Smith's economic thinking—that dealers must account for their own subsistence just as they do for workers' wages, revealing the parallel treatment of different types of economic actors. This adds genuine insight into the mechanics of market operations.

3.4 KiB Raw Blame History