Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

accumulation_of_stock

null

2026-02-23T00:11:52.068938

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes accumulation of stock as a specific economic process that enables employment of others and commercial ventures, marking a transition between economic stages. It avoids circularity and captures a distinct concept, though it could be slightly more precise about what constitutes "stock."

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book I, Chapter 6, where he explicitly discusses how accumulated stock enables profits and the employment of labor. The concept is central to Smith's analysis of how primitive economies transition to more complex commercial societies.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Accumulation" domain is perfectly appropriate for this entity, as it deals specifically with the gathering and concentration of wealth/capital. This is a fundamental economic process that deserves its own conceptual category in Smith's framework.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has some relevance to VSM as it relates to resource allocation and operational capacity (S1) and potentially strategic development (S4), but it's more of a foundational economic condition than a specific system function. It's somewhat abstract for direct VSM mapping.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory power by illuminating the fundamental mechanism that enables the transition from simple to complex economies and the emergence of profit as a price component. It explains a crucial structural transformation in economic organization.

Evaluation: Accumulation Of Stock

definition_precision — 4.0 / 5.0

The definition clearly distinguishes accumulation of stock as a specific economic process that enables employment of others and commercial ventures, marking a transition between economic stages. It avoids circularity and captures a distinct concept, though it could be slightly more precise about what constitutes "stock."

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book I, Chapter 6, where he explicitly discusses how accumulated stock enables profits and the employment of labor. The concept is central to Smith's analysis of how primitive economies transition to more complex commercial societies.

domain_placement — 5.0 / 5.0

The "Accumulation" domain is perfectly appropriate for this entity, as it deals specifically with the gathering and concentration of wealth/capital. This is a fundamental economic process that deserves its own conceptual category in Smith's framework.

vsm_relevance — 3.0 / 5.0

This entity has some relevance to VSM as it relates to resource allocation and operational capacity (S1) and potentially strategic development (S4), but it's more of a foundational economic condition than a specific system function. It's somewhat abstract for direct VSM mapping.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory power by illuminating the fundamental mechanism that enables the transition from simple to complex economies and the emergence of profit as a price component. It explains a crucial structural transformation in economic organization.

3.5 KiB Raw Blame History