coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/economic_connectivity_importance.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: economic_connectivity_importance
evaluator: null
evaluated_at: '2026-02-23T05:09:32.264894'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly identifies connectivity as the enabling factor
for division of labor and market expansion, with specific mechanisms outlined.
While "critical role" could be more precise, the definition successfully captures
a distinct economic concept rather than a vague umbrella term.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is strongly grounded in Smith's actual analysis in Book I,
Chapter 3, where he extensively discusses water-carriage, navigable rivers, and
how transportation connections enable market expansion. The examples cited (water-carriage,
navigable rivers, political barriers) directly reflect Smith's text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since connectivity fundamentally
enables the exchange relationships that allow markets to function and expand.
This concept sits at the heart of how exchange systems operate across geographic
and economic boundaries.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S1 (the operational connections between economic
units) and S4 (intelligence about environmental opportunities for market expansion).
The connectivity concept represents both operational infrastructure and strategic
intelligence about market possibilities.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides genuine explanatory power by illuminating the structural
mechanism through which markets expand and economies develop. It explains why
some regions prosper while others remain isolated, making it a key causal factor
rather than just a descriptive label.
---
# Evaluation: Economic Connectivity Importance
## definition_precision — 4.0 / 5.0
The definition clearly identifies connectivity as the enabling factor for division of labor and market expansion, with specific mechanisms outlined. While "critical role" could be more precise, the definition successfully captures a distinct economic concept rather than a vague umbrella term.
## source_grounding — 5.0 / 5.0
This entity is strongly grounded in Smith's actual analysis in Book I, Chapter 3, where he extensively discusses water-carriage, navigable rivers, and how transportation connections enable market expansion. The examples cited (water-carriage, navigable rivers, political barriers) directly reflect Smith's text.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since connectivity fundamentally enables the exchange relationships that allow markets to function and expand. This concept sits at the heart of how exchange systems operate across geographic and economic boundaries.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S1 (the operational connections between economic units) and S4 (intelligence about environmental opportunities for market expansion). The connectivity concept represents both operational infrastructure and strategic intelligence about market possibilities.
## explanatory_value — 5.0 / 5.0
This entity provides genuine explanatory power by illuminating the structural mechanism through which markets expand and economies develop. It explains why some regions prosper while others remain isolated, making it a key causal factor rather than just a descriptive label.