Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.8 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_failure_mechanisms

null

2026-02-23T00:40:13.838247

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific mechanisms (excessive note issuance, inadequate reserves, over-extension of credit) and describes the cyclical process of drawing and redrawing bills. It captures a distinct set of related processes rather than being vaguely general.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual analysis in Book II, Chapter 2, where he extensively discusses banking failures, particularly the mechanisms of excessive credit extension and the desperate measures banks take to maintain liquidity. The specific mention of drawing and redrawing bills reflects Smith's detailed examination of these practices.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate, as bank failure mechanisms are fundamentally about the breakdown of financial regulatory processes and the need for proper oversight. This directly relates to how financial systems should be governed and controlled.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to multiple VSM systems: S3 (internal regulation/audit) for monitoring bank health and reserves, S2 (coordination) for preventing systemic oscillations and failures, and S1 (operations) for the actual banking processes that can fail. The regulatory and monitoring aspects make it particularly relevant to VSM thinking.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity provides significant explanatory power by illuminating the structural mechanisms through which financial institutions fail, including the feedback loops and cascading effects that Smith identified. It goes beyond merely naming failures to explain the underlying processes and cycles that cause them.

Evaluation: Bank Failure Mechanisms

definition_precision — 4.0 / 5.0

The definition clearly identifies specific mechanisms (excessive note issuance, inadequate reserves, over-extension of credit) and describes the cyclical process of drawing and redrawing bills. It captures a distinct set of related processes rather than being vaguely general.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual analysis in Book II, Chapter 2, where he extensively discusses banking failures, particularly the mechanisms of excessive credit extension and the desperate measures banks take to maintain liquidity. The specific mention of drawing and redrawing bills reflects Smith's detailed examination of these practices.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate, as bank failure mechanisms are fundamentally about the breakdown of financial regulatory processes and the need for proper oversight. This directly relates to how financial systems should be governed and controlled.

vsm_relevance — 4.0 / 5.0

This entity maps well to multiple VSM systems: S3 (internal regulation/audit) for monitoring bank health and reserves, S2 (coordination) for preventing systemic oscillations and failures, and S1 (operations) for the actual banking processes that can fail. The regulatory and monitoring aspects make it particularly relevant to VSM thinking.

explanatory_value — 5.0 / 5.0

This entity provides significant explanatory power by illuminating the structural mechanisms through which financial institutions fail, including the feedback loops and cascading effects that Smith identified. It goes beyond merely naming failures to explain the underlying processes and cycles that cause them.

3.8 KiB Raw Blame History