Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_financial_innovation_diffusion

null

2026-02-23T00:40:40.437138

4.0

name	value	max_value	rationale
definition_precision	3.0	5.0	The definition captures a distinct concept about how banking innovations spread, but uses somewhat vague terms like "various factors" without specifying what these are. The core concept of diffusion is clear, though the mechanism could be more precisely articulated.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does discuss how banking innovations and practices spread throughout the economy and their effects on development, particularly in his analysis of different banking systems. The concept aligns well with his observations about how successful banking practices get adopted more widely.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Accumulation" is the correct domain placement since this process directly relates to how capital formation and banking efficiency improvements spread through the economy. The diffusion of financial innovations is fundamentally about enhancing the accumulation process.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it describes how the banking system learns from and adapts successful innovations. It also has elements of S2 (coordination) as diffusion involves coordinating new practices across the system.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity illuminates an important mechanism by which banking efficiency improvements propagate through the economy, explaining how localized innovations can have system-wide effects on economic development. It goes beyond surface description to identify a structural process.

Evaluation: Bank Financial Innovation Diffusion

definition_precision — 3.0 / 5.0

The definition captures a distinct concept about how banking innovations spread, but uses somewhat vague terms like "various factors" without specifying what these are. The core concept of diffusion is clear, though the mechanism could be more precisely articulated.

source_grounding — 4.0 / 5.0

Smith does discuss how banking innovations and practices spread throughout the economy and their effects on development, particularly in his analysis of different banking systems. The concept aligns well with his observations about how successful banking practices get adopted more widely.

domain_placement — 5.0 / 5.0

"Accumulation" is the correct domain placement since this process directly relates to how capital formation and banking efficiency improvements spread through the economy. The diffusion of financial innovations is fundamentally about enhancing the accumulation process.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it describes how the banking system learns from and adapts successful innovations. It also has elements of S2 (coordination) as diffusion involves coordinating new practices across the system.

explanatory_value — 4.0 / 5.0

This entity illuminates an important mechanism by which banking efficiency improvements propagate through the economy, explaining how localized innovations can have system-wide effects on economic development. It goes beyond surface description to identify a structural process.

3.4 KiB Raw Blame History