Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.5 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_financial_innovation

null

2026-02-23T00:41:15.363890

4.4

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies specific banking innovations (cash accounts, bill discounting methods) and their function in enhancing efficiency and utility. It avoids circularity and captures a distinct concept of technological/procedural advancement in banking.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion of Scottish banking innovations in Book II, Chapter 2, where he explicitly analyzes how new banking practices improved economic efficiency. The examples cited (cash accounts, bill discounting) are directly from Smith's text.

name	value	max_value	rationale
domain_placement	5.0	5.0	Placement in "Accumulation" domain is correct, as these banking innovations directly relate to Smith's analysis of how capital formation and circulation are enhanced through improved financial instruments. This fits perfectly within Book II's focus on the nature and accumulation of stock.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S4 (intelligence/environmental adaptation) as it represents the banking system's adaptive response to economic needs through innovation. It also has some S1 relevance as these innovations become operational banking practices.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism in Smith's theory - how financial innovation drives economic development by improving capital allocation efficiency. It explains a structural relationship between banking evolution and broader economic progress rather than merely naming a phenomenon.

Evaluation: Bank Financial Innovation

definition_precision — 4.0 / 5.0

The definition clearly identifies specific banking innovations (cash accounts, bill discounting methods) and their function in enhancing efficiency and utility. It avoids circularity and captures a distinct concept of technological/procedural advancement in banking.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion of Scottish banking innovations in Book II, Chapter 2, where he explicitly analyzes how new banking practices improved economic efficiency. The examples cited (cash accounts, bill discounting) are directly from Smith's text.

domain_placement — 5.0 / 5.0

Placement in "Accumulation" domain is correct, as these banking innovations directly relate to Smith's analysis of how capital formation and circulation are enhanced through improved financial instruments. This fits perfectly within Book II's focus on the nature and accumulation of stock.

vsm_relevance — 4.0 / 5.0

This entity maps well to S4 (intelligence/environmental adaptation) as it represents the banking system's adaptive response to economic needs through innovation. It also has some S1 relevance as these innovations become operational banking practices.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism in Smith's theory - how financial innovation drives economic development by improving capital allocation efficiency. It explains a structural relationship between banking evolution and broader economic progress rather than merely naming a phenomenon.

3.5 KiB Raw Blame History