Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.3 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

sober_people

null

2026-02-23T06:22:31.975151

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes "sober people" as productive borrowers who pay reasonable interest rates based on expected returns, contrasting them with speculators. The concept is well-bounded and captures a distinct economic actor type rather than being vague or circular.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's discussion in Book II, Chapter 4 about how appropriate interest rate regulation channels capital toward productive borrowers rather than speculators. Smith explicitly discusses this category of borrower as beneficial to the economy.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Accumulation" domain is perfectly appropriate since this concept deals with how capital is allocated and employed productively through borrowing and lending mechanisms. This is central to Smith's theory of capital accumulation.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S1 (as primary economic operators) or S3 (as part of the regulatory mechanism that ensures productive capital allocation). However, it's more of an actor category than a clear systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides significant explanatory value by illuminating the mechanism through which interest rate policy affects capital allocation and economic productivity. It helps explain how financial regulation can channel resources toward beneficial rather than speculative uses.

Evaluation: Sober People

definition_precision — 4.0 / 5.0

The definition clearly distinguishes "sober people" as productive borrowers who pay reasonable interest rates based on expected returns, contrasting them with speculators. The concept is well-bounded and captures a distinct economic actor type rather than being vague or circular.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's discussion in Book II, Chapter 4 about how appropriate interest rate regulation channels capital toward productive borrowers rather than speculators. Smith explicitly discusses this category of borrower as beneficial to the economy.

domain_placement — 5.0 / 5.0

The "Accumulation" domain is perfectly appropriate since this concept deals with how capital is allocated and employed productively through borrowing and lending mechanisms. This is central to Smith's theory of capital accumulation.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S1 (as primary economic operators) or S3 (as part of the regulatory mechanism that ensures productive capital allocation). However, it's more of an actor category than a clear systemic function.

explanatory_value — 4.0 / 5.0

The entity provides significant explanatory value by illuminating the mechanism through which interest rate policy affects capital allocation and economic productivity. It helps explain how financial regulation can channel resources toward beneficial rather than speculative uses.

3.3 KiB Raw Blame History