feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_financial_innovation_diffusion
evaluator: null
evaluated_at: '2026-02-23T00:40:40.437138'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a distinct concept about how banking innovations
spread, but uses somewhat vague terms like "various factors" without specifying
what these are. The core concept of diffusion is clear, though the mechanism could
be more precisely articulated.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does discuss how banking innovations and practices spread throughout
the economy and their effects on development, particularly in his analysis of
different banking systems. The concept aligns well with his observations about
how successful banking practices get adopted more widely.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Accumulation" is the correct domain placement since this process directly
relates to how capital formation and banking efficiency improvements spread through
the economy. The diffusion of financial innovations is fundamentally about enhancing
the accumulation process.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it describes how the banking system learns from and adapts successful innovations.
It also has elements of S2 (coordination) as diffusion involves coordinating new
practices across the system.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity illuminates an important mechanism by which banking efficiency
improvements propagate through the economy, explaining how localized innovations
can have system-wide effects on economic development. It goes beyond surface description
to identify a structural process.
---
# Evaluation: Bank Financial Innovation Diffusion
## definition_precision — 3.0 / 5.0
The definition captures a distinct concept about how banking innovations spread, but uses somewhat vague terms like "various factors" without specifying what these are. The core concept of diffusion is clear, though the mechanism could be more precisely articulated.
## source_grounding — 4.0 / 5.0
Smith does discuss how banking innovations and practices spread throughout the economy and their effects on development, particularly in his analysis of different banking systems. The concept aligns well with his observations about how successful banking practices get adopted more widely.
## domain_placement — 5.0 / 5.0
"Accumulation" is the correct domain placement since this process directly relates to how capital formation and banking efficiency improvements spread through the economy. The diffusion of financial innovations is fundamentally about enhancing the accumulation process.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it describes how the banking system learns from and adapts successful innovations. It also has elements of S2 (coordination) as diffusion involves coordinating new practices across the system.
## explanatory_value — 4.0 / 5.0
This entity illuminates an important mechanism by which banking efficiency improvements propagate through the economy, explaining how localized innovations can have system-wide effects on economic development. It goes beyond surface description to identify a structural process.