coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/bank_financial_innovation_impact.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_financial_innovation_impact
evaluator: null
evaluated_at: '2026-02-23T00:40:58.526861'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a distinct concept about banking innovation effects,
but uses somewhat vague terms like "significantly enhance" and "potentially destabilise"
without clear criteria. It could be more precise about what constitutes financial
innovation and how impacts are measured.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: Smith does analyze banking innovations and their economic effects in
Book II, Chapter 2, particularly discussing how new banking practices affect capital
circulation and economic development. The entity appears well-grounded in his
actual discussion of banking evolution and its consequences.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Accumulation" domain is perfectly appropriate since banking innovations
directly affect capital formation, circulation, and the accumulation process that
Smith analyzes in Book II. This is clearly an accumulation-related phenomenon
rather than production or distribution.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
banking innovations represent adaptive responses to environmental changes and
new intelligence about financial practices. It also has some S2 relevance regarding
coordination mechanisms in the financial system.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity illuminates an important mechanism by which banking systems
evolve and affect broader economic development, going beyond surface description
to capture how innovations create structural changes. It helps explain the dynamic
relationship between financial sector evolution and economic growth.
---
# Evaluation: Bank Financial Innovation Impact
## definition_precision — 3.0 / 5.0
The definition captures a distinct concept about banking innovation effects, but uses somewhat vague terms like "significantly enhance" and "potentially destabilise" without clear criteria. It could be more precise about what constitutes financial innovation and how impacts are measured.
## source_grounding — 4.0 / 5.0
Smith does analyze banking innovations and their economic effects in Book II, Chapter 2, particularly discussing how new banking practices affect capital circulation and economic development. The entity appears well-grounded in his actual discussion of banking evolution and its consequences.
## domain_placement — 5.0 / 5.0
The "Accumulation" domain is perfectly appropriate since banking innovations directly affect capital formation, circulation, and the accumulation process that Smith analyzes in Book II. This is clearly an accumulation-related phenomenon rather than production or distribution.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as banking innovations represent adaptive responses to environmental changes and new intelligence about financial practices. It also has some S2 relevance regarding coordination mechanisms in the financial system.
## explanatory_value — 4.0 / 5.0
The entity illuminates an important mechanism by which banking systems evolve and affect broader economic development, going beyond surface description to capture how innovations create structural changes. It helps explain the dynamic relationship between financial sector evolution and economic growth.