coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/bank_competition_effects.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: bank_competition_effects
evaluator: null
evaluated_at: '2026-02-23T00:37:33.842274'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies a distinct economic mechanism - how
competition among banks creates specific behavioral incentives and outcomes. It
avoids circularity and specifies concrete effects (prudence, efficiency, service
quality, risk diversification).
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's explicit arguments in Book
II, Chapter 2, where he discusses how banking competition naturally regulates
the industry and promotes stability. The entity accurately reflects Smith's actual
reasoning about competitive dynamics in banking.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain assignment since Smith presents competition
as a form of natural market regulation that governs banking behavior. This fits
perfectly within his broader framework of how market mechanisms can substitute
for or complement formal oversight.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S2 (coordination/anti-oscillation) as competition
serves as a coordinating mechanism that prevents excessive risk-taking and market
instability. It also has elements of S3 (internal regulation) as competitive pressure
creates self-regulating behavior within the banking system.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity illuminates a crucial structural mechanism in Smith's economic
theory - how competitive forces create endogenous regulatory effects without external
intervention. It explains the causal relationship between market structure and
institutional behavior, providing genuine insight into economic dynamics.
---
# Evaluation: Bank Competition Effects
## definition_precision — 4.0 / 5.0
The definition clearly identifies a distinct economic mechanism - how competition among banks creates specific behavioral incentives and outcomes. It avoids circularity and specifies concrete effects (prudence, efficiency, service quality, risk diversification).
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's explicit arguments in Book II, Chapter 2, where he discusses how banking competition naturally regulates the industry and promotes stability. The entity accurately reflects Smith's actual reasoning about competitive dynamics in banking.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain assignment since Smith presents competition as a form of natural market regulation that governs banking behavior. This fits perfectly within his broader framework of how market mechanisms can substitute for or complement formal oversight.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S2 (coordination/anti-oscillation) as competition serves as a coordinating mechanism that prevents excessive risk-taking and market instability. It also has elements of S3 (internal regulation) as competitive pressure creates self-regulating behavior within the banking system.
## explanatory_value — 5.0 / 5.0
This entity illuminates a crucial structural mechanism in Smith's economic theory - how competitive forces create endogenous regulatory effects without external intervention. It explains the causal relationship between market structure and institutional behavior, providing genuine insight into economic dynamics.