feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_credit_quality
evaluator: null
evaluated_at: '2026-02-23T00:38:07.244071'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes bank credit quality as the standard
of borrowers and investments, linking it specifically to repayment likelihood
and banking stability. It avoids circularity and captures a distinct concept,
though it could be slightly more precise about measurement criteria.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does examine banking practices and the importance of sound lending
in Book II, Chapter 2, discussing how banks should evaluate borrowers and maintain
prudent standards. The concept aligns well with his analysis of banking operations
and their economic effects.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the appropriate domain since credit quality standards
are fundamentally about how banks regulate their lending practices and maintain
institutional stability. This fits perfectly within regulatory and prudential
banking concepts.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation/audit) as credit quality
assessment is a key internal control mechanism for banks. It also has relevance
to S2 (coordination) in terms of maintaining system stability across the banking
sector.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important mechanism by which banks maintain
stability and contribute to economic development through prudent lending standards.
It explains a structural relationship between lending practices and broader economic
outcomes rather than merely naming a surface phenomenon.
---
# Evaluation: Bank Credit Quality
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes bank credit quality as the standard of borrowers and investments, linking it specifically to repayment likelihood and banking stability. It avoids circularity and captures a distinct concept, though it could be slightly more precise about measurement criteria.
## source_grounding — 4.0 / 5.0
Smith does examine banking practices and the importance of sound lending in Book II, Chapter 2, discussing how banks should evaluate borrowers and maintain prudent standards. The concept aligns well with his analysis of banking operations and their economic effects.
## domain_placement — 5.0 / 5.0
"Regulation" is the appropriate domain since credit quality standards are fundamentally about how banks regulate their lending practices and maintain institutional stability. This fits perfectly within regulatory and prudential banking concepts.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation/audit) as credit quality assessment is a key internal control mechanism for banks. It also has relevance to S2 (coordination) in terms of maintaining system stability across the banking sector.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important mechanism by which banks maintain stability and contribute to economic development through prudent lending standards. It explains a structural relationship between lending practices and broader economic outcomes rather than merely naming a surface phenomenon.