coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

65
examples/infospace-with-history/output/evaluations/agricultural_spatial_inequality.md Normal file
View File

@@ -0,0 +1,65 @@
---
entity_slug: agricultural_spatial_inequality
evaluator: null
evaluated_at: '2026-02-23T00:31:21.178419'
overall_score: 4.0
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes agricultural spatial inequality
as economic disparities between regions based on specific factors (natural advantages,
institutions, market access). It avoids circularity and identifies distinct causal
mechanisms rather than being a vague umbrella term.
- name: source_grounding
value: 4.0
max_value: 5.0
rationale: This concept is well-grounded in Book III, Chapter 2, where Smith explicitly
discusses how medieval regulations prevented naturally advantaged agricultural
regions from exploiting their advantages while hampering disadvantaged areas.
The entity accurately reflects Smith's analysis of regional agricultural disparities.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain placement is excellent, as Smith's analysis focuses
on how restrictions on trade and market access created and perpetuated these regional
inequalities. The concept is fundamentally about exchange relationships and market
mechanisms.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental
adaptation) as it concerns how economic systems respond to environmental advantages
and institutional constraints. However, it's somewhat abstract and doesn't clearly
align with operational VSM functions.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides strong explanatory value by illuminating the structural
mechanism through which medieval institutions created persistent regional inequalities,
showing how regulatory frameworks can prevent natural comparative advantages from
being realized. This goes beyond surface description to reveal underlying economic
dynamics.
---
# Evaluation: Agricultural Spatial Inequality
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes agricultural spatial inequality as economic disparities between regions based on specific factors (natural advantages, institutions, market access). It avoids circularity and identifies distinct causal mechanisms rather than being a vague umbrella term.
## source_grounding — 4.0 / 5.0
This concept is well-grounded in Book III, Chapter 2, where Smith explicitly discusses how medieval regulations prevented naturally advantaged agricultural regions from exploiting their advantages while hampering disadvantaged areas. The entity accurately reflects Smith's analysis of regional agricultural disparities.
## domain_placement — 5.0 / 5.0
The "Exchange" domain placement is excellent, as Smith's analysis focuses on how restrictions on trade and market access created and perpetuated these regional inequalities. The concept is fundamentally about exchange relationships and market mechanisms.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S4 (intelligence/environmental adaptation) as it concerns how economic systems respond to environmental advantages and institutional constraints. However, it's somewhat abstract and doesn't clearly align with operational VSM functions.
## explanatory_value — 4.0 / 5.0
The entity provides strong explanatory value by illuminating the structural mechanism through which medieval institutions created persistent regional inequalities, showing how regulatory frameworks can prevent natural comparative advantages from being realized. This goes beyond surface description to reveal underlying economic dynamics.