coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/colonial_economic_stability.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: colonial_economic_stability
evaluator: null
evaluated_at: '2026-02-23T04:47:18.526839'
overall_score: 4.0
scores:
- name: definition_precision
value: 3.0
max_value: 5.0
rationale: The definition captures a coherent concept of economic resilience but
is somewhat broad, encompassing multiple related phenomena (growth consistency,
market management, adaptability). While not circular, it could be more precise
about what specifically constitutes "stability" versus other economic outcomes.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This entity is well-grounded in Smith's actual arguments about colonial
monopolies creating artificial dependencies and limiting adaptive capacity. The
connection between economic freedom, diversification, and stability reflects Smith's
explicit reasoning about the negative effects of restrictive colonial policies.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this entity
represents a broad theoretical principle about the relationship between economic
freedom and stability that applies across Smith''s analysis. It''s not specific
to particular mechanisms but rather a general economic principle.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to VSM System 4 (intelligence/environmental adaptation)
as it concerns an economy's ability to adapt to changing conditions and external
shocks. It also relates to System 2 (anti-oscillation) through its focus on managing
market fluctuations and maintaining stability.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating the structural
relationship between economic freedom, diversification, and systemic resilience.
It helps explain why Smith advocates against monopolistic colonial arrangements
by showing the stability benefits of more open economic systems.
---
# Evaluation: Colonial Economic Stability
## definition_precision — 3.0 / 5.0
The definition captures a coherent concept of economic resilience but is somewhat broad, encompassing multiple related phenomena (growth consistency, market management, adaptability). While not circular, it could be more precise about what specifically constitutes "stability" versus other economic outcomes.
## source_grounding — 4.0 / 5.0
This entity is well-grounded in Smith's actual arguments about colonial monopolies creating artificial dependencies and limiting adaptive capacity. The connection between economic freedom, diversification, and stability reflects Smith's explicit reasoning about the negative effects of restrictive colonial policies.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this entity represents a broad theoretical principle about the relationship between economic freedom and stability that applies across Smith's analysis. It's not specific to particular mechanisms but rather a general economic principle.
## vsm_relevance — 4.0 / 5.0
This entity maps well to VSM System 4 (intelligence/environmental adaptation) as it concerns an economy's ability to adapt to changing conditions and external shocks. It also relates to System 2 (anti-oscillation) through its focus on managing market fluctuations and maintaining stability.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating the structural relationship between economic freedom, diversification, and systemic resilience. It helps explain why Smith advocates against monopolistic colonial arrangements by showing the stability benefits of more open economic systems.