coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

67
examples/infospace-with-history/output/evaluations/parsimony_and_privation.md Normal file
View File

@@ -0,0 +1,67 @@
---
entity_slug: parsimony_and_privation
evaluator: null
evaluated_at: '2026-02-23T06:04:36.693693'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes between two economic strategies
- one based on saving/deprivation for commercial nations versus industry/enjoyment
for agricultural nations. It's precise in identifying the specific contrast Smith
draws, though it could be slightly more explicit about what constitutes "merchants,
artificers, and manufacturers" versus agricultural systems.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity appears well-grounded in Book IV, Chapter 9, where Smith
explicitly discusses different paths to wealth accumulation for different types
of nations. The contrast between commercial nations requiring frugality versus
agricultural nations being able to combine enjoyment with wealth creation is a
genuine Smithian distinction.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Accumulation" domain is perfectly appropriate since this entity
directly addresses different mechanisms by which nations accumulate wealth. The
concept is fundamentally about capital formation and wealth-building strategies
across different economic structures.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental
adaptation) as it describes how different national economic structures must adapt
different strategies based on their composition. However, it's more of a strategic
principle than an operational system component.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: This entity provides significant explanatory value by illuminating why
different economic structures require fundamentally different approaches to wealth
accumulation. It reveals an important structural relationship between a nation's
economic composition and its optimal growth strategy, going beyond surface description
to explain underlying mechanisms.
---
# Evaluation: Parsimony And Privation
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes between two economic strategies - one based on saving/deprivation for commercial nations versus industry/enjoyment for agricultural nations. It's precise in identifying the specific contrast Smith draws, though it could be slightly more explicit about what constitutes "merchants, artificers, and manufacturers" versus agricultural systems.
## source_grounding — 5.0 / 5.0
This entity appears well-grounded in Book IV, Chapter 9, where Smith explicitly discusses different paths to wealth accumulation for different types of nations. The contrast between commercial nations requiring frugality versus agricultural nations being able to combine enjoyment with wealth creation is a genuine Smithian distinction.
## domain_placement — 5.0 / 5.0
The "Accumulation" domain is perfectly appropriate since this entity directly addresses different mechanisms by which nations accumulate wealth. The concept is fundamentally about capital formation and wealth-building strategies across different economic structures.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/environmental adaptation) as it describes how different national economic structures must adapt different strategies based on their composition. However, it's more of a strategic principle than an operational system component.
## explanatory_value — 4.0 / 5.0
This entity provides significant explanatory value by illuminating why different economic structures require fundamentally different approaches to wealth accumulation. It reveals an important structural relationship between a nation's economic composition and its optimal growth strategy, going beyond surface description to explain underlying mechanisms.