coulomb/markitect-main
2
0
Fork 0
Code Issues 62 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

69
examples/infospace-with-history/output/evaluations/mediterranean_civilisation_pattern.md Normal file
View File

@@ -0,0 +1,69 @@
---
entity_slug: mediterranean_civilisation_pattern
evaluator: null
evaluated_at: '2026-02-23T05:50:08.456117'
overall_score: 4.0
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies a specific historical pattern of economic
development tied to Mediterranean geography, avoiding circularity and capturing
a distinct concept about how natural transportation advantages enable early specialization.
The definition could be slightly more precise about what constitutes "early economic
development" but is otherwise well-bounded.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
3, where he explicitly discusses how the Mediterranean's geographical features
(smoothness, islands, proximity of shores) made it the first site of civilization
due to accessible navigation. The entity accurately reflects Smith's argument
without introducing external concepts.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this entity
represents a broad theoretical principle about how geographical advantages create
conditions for economic development and specialization. It''s not specific to
any particular economic mechanism but rather illustrates a foundational concept
about the relationship between geography and economic progress.'
- name: vsm_relevance
value: 2.0
max_value: 5.0
rationale: This entity is largely VSM-neutral as it describes a historical pattern
rather than an operational system component. While it might loosely relate to
S4 (environmental adaptation) in terms of how civilizations adapt to geographical
advantages, it doesn't naturally map to specific VSM systems and remains too abstract
for clear VSM placement.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating the mechanism
through which geographical advantages (navigable waters) create structural conditions
for trade, specialization, and economic development. It demonstrates a causal
relationship between natural endowments and economic progress, though it represents
more of a historical example than a generalizable economic principle.
---
# Evaluation: Mediterranean Civilisation Pattern
## definition_precision — 4.0 / 5.0
The definition clearly identifies a specific historical pattern of economic development tied to Mediterranean geography, avoiding circularity and capturing a distinct concept about how natural transportation advantages enable early specialization. The definition could be slightly more precise about what constitutes "early economic development" but is otherwise well-bounded.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book I, Chapter 3, where he explicitly discusses how the Mediterranean's geographical features (smoothness, islands, proximity of shores) made it the first site of civilization due to accessible navigation. The entity accurately reflects Smith's argument without introducing external concepts.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this entity represents a broad theoretical principle about how geographical advantages create conditions for economic development and specialization. It's not specific to any particular economic mechanism but rather illustrates a foundational concept about the relationship between geography and economic progress.
## vsm_relevance — 2.0 / 5.0
This entity is largely VSM-neutral as it describes a historical pattern rather than an operational system component. While it might loosely relate to S4 (environmental adaptation) in terms of how civilizations adapt to geographical advantages, it doesn't naturally map to specific VSM systems and remains too abstract for clear VSM placement.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating the mechanism through which geographical advantages (navigable waters) create structural conditions for trade, specialization, and economic development. It demonstrates a causal relationship between natural endowments and economic progress, though it represents more of a historical example than a generalizable economic principle.