Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.4 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

bank_credit_quality

null

2026-02-23T00:38:07.244071

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes bank credit quality as the standard of borrowers and investments, linking it specifically to repayment likelihood and banking stability. It avoids circularity and captures a distinct concept, though it could be slightly more precise about measurement criteria.

name	value	max_value	rationale
source_grounding	4.0	5.0	Smith does examine banking practices and the importance of sound lending in Book II, Chapter 2, discussing how banks should evaluate borrowers and maintain prudent standards. The concept aligns well with his analysis of banking operations and their economic effects.

name	value	max_value	rationale
domain_placement	5.0	5.0	"Regulation" is the appropriate domain since credit quality standards are fundamentally about how banks regulate their lending practices and maintain institutional stability. This fits perfectly within regulatory and prudential banking concepts.

name	value	max_value	rationale
vsm_relevance	4.0	5.0	This entity maps well to S3 (internal regulation/audit) as credit quality assessment is a key internal control mechanism for banks. It also has relevance to S2 (coordination) in terms of maintaining system stability across the banking sector.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity illuminates an important mechanism by which banks maintain stability and contribute to economic development through prudent lending standards. It explains a structural relationship between lending practices and broader economic outcomes rather than merely naming a surface phenomenon.

Evaluation: Bank Credit Quality

definition_precision — 4.0 / 5.0

The definition clearly distinguishes bank credit quality as the standard of borrowers and investments, linking it specifically to repayment likelihood and banking stability. It avoids circularity and captures a distinct concept, though it could be slightly more precise about measurement criteria.

source_grounding — 4.0 / 5.0

Smith does examine banking practices and the importance of sound lending in Book II, Chapter 2, discussing how banks should evaluate borrowers and maintain prudent standards. The concept aligns well with his analysis of banking operations and their economic effects.

domain_placement — 5.0 / 5.0

"Regulation" is the appropriate domain since credit quality standards are fundamentally about how banks regulate their lending practices and maintain institutional stability. This fits perfectly within regulatory and prudential banking concepts.

vsm_relevance — 4.0 / 5.0

This entity maps well to S3 (internal regulation/audit) as credit quality assessment is a key internal control mechanism for banks. It also has relevance to S2 (coordination) in terms of maintaining system stability across the banking sector.

explanatory_value — 4.0 / 5.0

The entity illuminates an important mechanism by which banks maintain stability and contribute to economic development through prudent lending standards. It explains a structural relationship between lending practices and broader economic outcomes rather than merely naming a surface phenomenon.

3.4 KiB Raw Blame History