coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/bank_economic_growth.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_economic_growth
evaluator: null
evaluated_at: '2026-02-23T00:39:27.419352'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition identifies banking's contribution to economic growth through
specific channels (capital allocation, transaction facilitation, financial innovation),
which provides some precision. However, the phrase "banking growth can significantly
enhance economic development" is somewhat circular and the overall definition
remains fairly broad.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does examine banking's role in economic development in Book II,
Chapter 2, particularly how banks facilitate capital circulation and productive
investment. The concept aligns well with Smith's analysis of how banking institutions
support the wealth-generating process.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: Placement in the "Accumulation" domain is highly appropriate since Book
II focuses on the accumulation of stock/capital, and banking's contribution to
growth directly relates to how capital is accumulated and deployed productively.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S1 (primary operations of capital allocation)
and S4 (intelligence function of banks in directing capital to productive uses
and adapting to economic opportunities). Banking serves both operational and adaptive
intelligence functions in the economic system.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important structural mechanism - how banking
institutions systematically contribute to economic growth through multiple channels
rather than just being passive repositories. It captures a key dynamic relationship
in Smith's economic framework.
---
# Evaluation: Bank Economic Growth
## definition_precision — 3.0 / 5.0
The definition identifies banking's contribution to economic growth through specific channels (capital allocation, transaction facilitation, financial innovation), which provides some precision. However, the phrase "banking growth can significantly enhance economic development" is somewhat circular and the overall definition remains fairly broad.
## source_grounding — 4.0 / 5.0
Smith does examine banking's role in economic development in Book II, Chapter 2, particularly how banks facilitate capital circulation and productive investment. The concept aligns well with Smith's analysis of how banking institutions support the wealth-generating process.
## domain_placement — 5.0 / 5.0
Placement in the "Accumulation" domain is highly appropriate since Book II focuses on the accumulation of stock/capital, and banking's contribution to growth directly relates to how capital is accumulated and deployed productively.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S1 (primary operations of capital allocation) and S4 (intelligence function of banks in directing capital to productive uses and adapting to economic opportunities). Banking serves both operational and adaptive intelligence functions in the economic system.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important structural mechanism - how banking institutions systematically contribute to economic growth through multiple channels rather than just being passive repositories. It captures a key dynamic relationship in Smith's economic framework.