coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

63
examples/infospace-with-history/output/evaluations/bank_financial_intermediation_efficiency.md Normal file
View File

@@ -0,0 +1,63 @@
---
entity_slug: bank_financial_intermediation_efficiency
evaluator: null
evaluated_at: '2026-02-23T00:41:23.641070'
overall_score: 4.0
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly specifies what bank financial intermediation efficiency
entails - channeling funds from savers to borrowers while minimizing costs and
risks. It avoids circularity and captures a distinct measurable concept with clear
inputs, processes, and outcomes.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does analyze banking and financial intermediation in Book II, Chapter
2, discussing how banks facilitate capital allocation and the importance of efficient
financial systems for economic development. The concept aligns well with Smith's
treatment of banking's role in the economy.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: Placement in the "Accumulation" domain is highly appropriate since financial
intermediation efficiency directly affects how effectively savings are converted
into productive investment, which is central to capital accumulation processes.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S1 (as a
core operational function of the financial system) and potentially S3 (as it involves
regulatory/audit functions regarding risk management). However, it's somewhat
abstract and could span multiple systems.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides strong explanatory value by illuminating a key mechanism
through which financial systems contribute to economic productivity - the efficiency
of matching savers with borrowers affects overall capital allocation and economic
growth rates.
---
# Evaluation: Bank Financial Intermediation Efficiency
## definition_precision — 4.0 / 5.0
The definition clearly specifies what bank financial intermediation efficiency entails - channeling funds from savers to borrowers while minimizing costs and risks. It avoids circularity and captures a distinct measurable concept with clear inputs, processes, and outcomes.
## source_grounding — 4.0 / 5.0
Smith does analyze banking and financial intermediation in Book II, Chapter 2, discussing how banks facilitate capital allocation and the importance of efficient financial systems for economic development. The concept aligns well with Smith's treatment of banking's role in the economy.
## domain_placement — 5.0 / 5.0
Placement in the "Accumulation" domain is highly appropriate since financial intermediation efficiency directly affects how effectively savings are converted into productive investment, which is central to capital accumulation processes.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S1 (as a core operational function of the financial system) and potentially S3 (as it involves regulatory/audit functions regarding risk management). However, it's somewhat abstract and could span multiple systems.
## explanatory_value — 4.0 / 5.0
The entity provides strong explanatory value by illuminating a key mechanism through which financial systems contribute to economic productivity - the efficiency of matching savers with borrowers affects overall capital allocation and economic growth rates.