coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/bank_financial_innovation.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_financial_innovation
evaluator: null
evaluated_at: '2026-02-23T00:41:15.363890'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies specific banking innovations (cash
accounts, bill discounting methods) and their function in enhancing efficiency
and utility. It avoids circularity and captures a distinct concept of technological/procedural
advancement in banking.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual discussion of Scottish
banking innovations in Book II, Chapter 2, where he explicitly analyzes how new
banking practices improved economic efficiency. The examples cited (cash accounts,
bill discounting) are directly from Smith's text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: Placement in "Accumulation" domain is correct, as these banking innovations
directly relate to Smith's analysis of how capital formation and circulation are
enhanced through improved financial instruments. This fits perfectly within Book
II's focus on the nature and accumulation of stock.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents the banking system's adaptive response to economic needs through
innovation. It also has some S1 relevance as these innovations become operational
banking practices.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important mechanism in Smith's theory - how
financial innovation drives economic development by improving capital allocation
efficiency. It explains a structural relationship between banking evolution and
broader economic progress rather than merely naming a phenomenon.
---
# Evaluation: Bank Financial Innovation
## definition_precision — 4.0 / 5.0
The definition clearly identifies specific banking innovations (cash accounts, bill discounting methods) and their function in enhancing efficiency and utility. It avoids circularity and captures a distinct concept of technological/procedural advancement in banking.
## source_grounding — 5.0 / 5.0
This entity is well-grounded in Smith's actual discussion of Scottish banking innovations in Book II, Chapter 2, where he explicitly analyzes how new banking practices improved economic efficiency. The examples cited (cash accounts, bill discounting) are directly from Smith's text.
## domain_placement — 5.0 / 5.0
Placement in "Accumulation" domain is correct, as these banking innovations directly relate to Smith's analysis of how capital formation and circulation are enhanced through improved financial instruments. This fits perfectly within Book II's focus on the nature and accumulation of stock.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents the banking system's adaptive response to economic needs through innovation. It also has some S1 relevance as these innovations become operational banking practices.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important mechanism in Smith's theory - how financial innovation drives economic development by improving capital allocation efficiency. It explains a structural relationship between banking evolution and broader economic progress rather than merely naming a phenomenon.