Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_competition_effects

null

2026-02-23T00:37:33.842274

4.6

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a distinct economic mechanism - how competition among banks creates specific behavioral incentives and outcomes. It avoids circularity and specifies concrete effects (prudence, efficiency, service quality, risk diversification).

name	value	max_value	rationale
source_grounding	5.0	5.0	This concept is directly grounded in Smith's explicit arguments in Book II, Chapter 2, where he discusses how banking competition naturally regulates the industry and promotes stability. The entity accurately reflects Smith's actual reasoning about competitive dynamics in banking.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the correct domain assignment since Smith presents competition as a form of natural market regulation that governs banking behavior. This fits perfectly within his broader framework of how market mechanisms can substitute for or complement formal oversight.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S2 (coordination/anti-oscillation) as competition serves as a coordinating mechanism that prevents excessive risk-taking and market instability. It also has elements of S3 (internal regulation) as competitive pressure creates self-regulating behavior within the banking system.

name	value	max_value	rationale
explanatory_value	5.0	5.0	This entity illuminates a crucial structural mechanism in Smith's economic theory - how competitive forces create endogenous regulatory effects without external intervention. It explains the causal relationship between market structure and institutional behavior, providing genuine insight into economic dynamics.

Evaluation: Bank Competition Effects

definition_precision — 4.0 / 5.0

The definition clearly identifies a distinct economic mechanism - how competition among banks creates specific behavioral incentives and outcomes. It avoids circularity and specifies concrete effects (prudence, efficiency, service quality, risk diversification).

source_grounding — 5.0 / 5.0

This concept is directly grounded in Smith's explicit arguments in Book II, Chapter 2, where he discusses how banking competition naturally regulates the industry and promotes stability. The entity accurately reflects Smith's actual reasoning about competitive dynamics in banking.

domain_placement — 5.0 / 5.0

"Regulation" is the correct domain assignment since Smith presents competition as a form of natural market regulation that governs banking behavior. This fits perfectly within his broader framework of how market mechanisms can substitute for or complement formal oversight.

vsm_relevance — 4.0 / 5.0

This entity maps well to S2 (coordination/anti-oscillation) as competition serves as a coordinating mechanism that prevents excessive risk-taking and market instability. It also has elements of S3 (internal regulation) as competitive pressure creates self-regulating behavior within the banking system.

explanatory_value — 5.0 / 5.0

This entity illuminates a crucial structural mechanism in Smith's economic theory - how competitive forces create endogenous regulatory effects without external intervention. It explains the causal relationship between market structure and institutional behavior, providing genuine insight into economic dynamics.

3.5 KiB Raw Blame History