Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

capital_employed

null

2026-02-23T04:40:26.614764

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes capital employed as the total value of resources (materials and wages) advanced by an investor, which is precise and non-circular. It could be slightly more precise about whether this includes only working capital or also fixed capital investments.

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Book I, Chapter 6 where Smith explicitly discusses how profits relate to the amount of capital employed rather than labor supervision. The entity accurately reflects Smith's actual argument with specific textual support.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in the "Accumulation" domain is highly appropriate since capital employed represents the stock of resources committed to productive processes. This aligns perfectly with Smith's broader discussion of capital accumulation and investment.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as the resources directly engaged in production, with some connection to S3 (internal regulation) regarding resource allocation decisions. However, it's somewhat abstract as a financial concept rather than an operational system component.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides excellent explanatory value by illuminating Smith's key mechanism for profit determination—that profits are regulated by capital employed rather than supervisory labor. It reveals a fundamental structural relationship in Smith's economic theory about how returns are generated.

Evaluation: Capital Employed

definition_precision — 4.0 / 5.0

The definition clearly distinguishes capital employed as the total value of resources (materials and wages) advanced by an investor, which is precise and non-circular. It could be slightly more precise about whether this includes only working capital or also fixed capital investments.

source_grounding — 5.0 / 5.0

This concept is directly grounded in Book I, Chapter 6 where Smith explicitly discusses how profits relate to the amount of capital employed rather than labor supervision. The entity accurately reflects Smith's actual argument with specific textual support.

domain_placement — 5.0 / 5.0

Placement in the "Accumulation" domain is highly appropriate since capital employed represents the stock of resources committed to productive processes. This aligns perfectly with Smith's broader discussion of capital accumulation and investment.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, primarily mapping to S1 (primary operations) as the resources directly engaged in production, with some connection to S3 (internal regulation) regarding resource allocation decisions. However, it's somewhat abstract as a financial concept rather than an operational system component.

explanatory_value — 5.0 / 5.0

This entity provides excellent explanatory value by illuminating Smith's key mechanism for profit determination—that profits are regulated by capital employed rather than supervisory labor. It reveals a fundamental structural relationship in Smith's economic theory about how returns are generated.

3.5 KiB Raw Blame History