Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

effectual_demand

null

2026-02-23T05:22:40.826598

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes effectual demand from mere desire by emphasizing both willingness and ability to pay the full costs of production. The contrast with "absolute demand" and the coach example provide concrete boundaries for this concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly from Smith's text in Book I, Chapter 7, where he explicitly contrasts effectual demand with absolute demand using the poor man and coach example. The terminology and conceptual distinction are authentically Smithian.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Exchange" is the correct domain placement since effectual demand is fundamentally about market transactions and the conditions under which exchanges actually occur. This concept sits at the heart of Smith's market mechanism analysis.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Effectual demand has some relevance to S4 (intelligence/environmental adaptation) as it represents market information about viable demand conditions, but it's primarily a market-level concept that doesn't map cleanly to organizational cybernetic functions. It's more VSM-neutral than clearly assignable.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This concept provides crucial explanatory power for understanding how market prices are determined and why some potential demands don't translate into actual market activity. It illuminates the fundamental mechanism distinguishing effective market signals from mere wants.

Evaluation: Effectual Demand

definition_precision — 4.0 / 5.0

The definition clearly distinguishes effectual demand from mere desire by emphasizing both willingness and ability to pay the full costs of production. The contrast with "absolute demand" and the coach example provide concrete boundaries for this concept.

source_grounding — 5.0 / 5.0

This concept is directly from Smith's text in Book I, Chapter 7, where he explicitly contrasts effectual demand with absolute demand using the poor man and coach example. The terminology and conceptual distinction are authentically Smithian.

domain_placement — 5.0 / 5.0

"Exchange" is the correct domain placement since effectual demand is fundamentally about market transactions and the conditions under which exchanges actually occur. This concept sits at the heart of Smith's market mechanism analysis.

vsm_relevance — 3.0 / 5.0

Effectual demand has some relevance to S4 (intelligence/environmental adaptation) as it represents market information about viable demand conditions, but it's primarily a market-level concept that doesn't map cleanly to organizational cybernetic functions. It's more VSM-neutral than clearly assignable.

explanatory_value — 5.0 / 5.0

This concept provides crucial explanatory power for understanding how market prices are determined and why some potential demands don't translate into actual market activity. It illuminates the fundamental mechanism distinguishing effective market signals from mere wants.

3.3 KiB Raw Blame History