feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,65 @@
---
entity_slug: bank_information_asymmetry
evaluator: null
evaluated_at: '2026-02-23T00:42:25.594624'
overall_score: 4.0
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly articulates the concept of information asymmetry
in banking contexts, distinguishing it from general market information problems.
It specifies the parties involved (banks vs. other market participants) and the
consequences (effects on credit allocation and risk assessment).
- name: source_grounding
value: 3.0
max_value: 5.0
rationale: While Smith does discuss banking operations and credit assessment in
Book II, Chapter 2, the specific framing of "information asymmetry" uses modern
economic terminology that may not directly reflect Smith's 18th-century conceptual
framework. The underlying ideas about banks' superior knowledge are present, but
the theoretical construct is somewhat anachronistic.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate for this concept, as information
asymmetry fundamentally concerns how information flows (or fails to flow) between
parties in financial transactions. This is a core aspect of exchange mechanisms
and market functioning.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it concerns how banks gather and process information about their environment to
make lending decisions. It also relates to S3 (internal regulation) in terms of
risk management processes that banks must implement to handle information gaps.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The concept provides significant explanatory power for understanding
banking mechanisms, credit markets, and financial intermediation. It illuminates
why banks exist as specialized institutions and explains structural features of
financial systems rather than merely describing surface phenomena.
---
# Evaluation: Bank Information Asymmetry
## definition_precision — 4.0 / 5.0
The definition clearly articulates the concept of information asymmetry in banking contexts, distinguishing it from general market information problems. It specifies the parties involved (banks vs. other market participants) and the consequences (effects on credit allocation and risk assessment).
## source_grounding — 3.0 / 5.0
While Smith does discuss banking operations and credit assessment in Book II, Chapter 2, the specific framing of "information asymmetry" uses modern economic terminology that may not directly reflect Smith's 18th-century conceptual framework. The underlying ideas about banks' superior knowledge are present, but the theoretical construct is somewhat anachronistic.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate for this concept, as information asymmetry fundamentally concerns how information flows (or fails to flow) between parties in financial transactions. This is a core aspect of exchange mechanisms and market functioning.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it concerns how banks gather and process information about their environment to make lending decisions. It also relates to S3 (internal regulation) in terms of risk management processes that banks must implement to handle information gaps.
## explanatory_value — 4.0 / 5.0
The concept provides significant explanatory power for understanding banking mechanisms, credit markets, and financial intermediation. It illuminates why banks exist as specialized institutions and explains structural features of financial systems rather than merely describing surface phenomena.