Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.7 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

prodigals_and_projectors

null

2026-02-23T06:09:23.873419

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes between two types of risky borrowers with distinct motivations - prodigals seeking consumption funds versus projectors pursuing speculative ventures. The concept is well-bounded and avoids circularity by defining the actors through their willingness to pay high interest rates and their economic risk profiles.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's text from Book II, Chapter 4, where he explicitly discusses these two categories of borrowers and their role in his argument about interest rate regulation. The terminology and conceptual framework come straight from the source material.

name	value	max_value	rationale
domain_placement	4.0	5.0	The "Distribution" domain assignment is appropriate since this concept deals with how capital flows to different types of borrowers based on interest rate policies. While it could potentially fit in a "Capital" domain, distribution captures the allocative mechanism Smith is analyzing.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/adaptation) as it represents actors who respond to environmental signals (interest rates) in ways that can destabilize the economic system. However, the mapping is not as natural as more structural economic concepts.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating Smith's mechanism for how interest rate policy affects capital allocation and economic stability. It reveals the structural relationship between regulatory frameworks and the types of economic activity that get funded.

Evaluation: Prodigals And Projectors

definition_precision — 4.0 / 5.0

The definition clearly distinguishes between two types of risky borrowers with distinct motivations - prodigals seeking consumption funds versus projectors pursuing speculative ventures. The concept is well-bounded and avoids circularity by defining the actors through their willingness to pay high interest rates and their economic risk profiles.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's text from Book II, Chapter 4, where he explicitly discusses these two categories of borrowers and their role in his argument about interest rate regulation. The terminology and conceptual framework come straight from the source material.

domain_placement — 4.0 / 5.0

The "Distribution" domain assignment is appropriate since this concept deals with how capital flows to different types of borrowers based on interest rate policies. While it could potentially fit in a "Capital" domain, distribution captures the allocative mechanism Smith is analyzing.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/adaptation) as it represents actors who respond to environmental signals (interest rates) in ways that can destabilize the economic system. However, the mapping is not as natural as more structural economic concepts.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating Smith's mechanism for how interest rate policy affects capital allocation and economic stability. It reveals the structural relationship between regulatory frameworks and the types of economic activity that get funded.

3.7 KiB Raw Blame History