coulomb/markitect-main
2
0
Fork 0
Code Issues 62 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

66
examples/infospace-with-history/output/evaluations/agricultural_development_sequence.md Normal file
View File

@@ -0,0 +1,66 @@
---
entity_slug: agricultural_development_sequence
evaluator: null
evaluated_at: '2026-02-23T00:26:36.595549'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: "The definition clearly outlines a specific historical progression through\
\ distinct stages (subsistence \u2192 servile \u2192 metayer \u2192 yeoman farming)\
\ with identifiable characteristics at each stage. While comprehensive, it could\
\ be slightly more precise about what constitutes \"increasing economic efficiency\"\
\ in measurable terms."
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Book III, Chapter 2 of The Wealth
of Nations, where Smith explicitly traces this agricultural development sequence
and argues for the superior efficiency of independent yeoman farming. The progression
described matches Smith's historical analysis of agricultural systems.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the appropriate domain placement as this represents
Smith''s broader theoretical framework about economic development and institutional
evolution. This is a foundational theoretical concept rather than a specific policy
mechanism or market operation.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it describes how agricultural systems adapt and evolve in response to changing
legal, social, and economic environments. It also has some S5 relevance regarding
the identity and policy frameworks that enable different agricultural arrangements.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by illuminating the
structural mechanisms behind agricultural productivity improvements and showing
how institutional changes drive economic development. It explains why some regions
advanced economically while others remained stagnant, making it a key analytical
framework in Smith's theory.
---
# Evaluation: Agricultural Development Sequence
## definition_precision — 4.0 / 5.0
The definition clearly outlines a specific historical progression through distinct stages (subsistence → servile → metayer → yeoman farming) with identifiable characteristics at each stage. While comprehensive, it could be slightly more precise about what constitutes "increasing economic efficiency" in measurable terms.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Book III, Chapter 2 of The Wealth of Nations, where Smith explicitly traces this agricultural development sequence and argues for the superior efficiency of independent yeoman farming. The progression described matches Smith's historical analysis of agricultural systems.
## domain_placement — 5.0 / 5.0
"General Theory" is the appropriate domain placement as this represents Smith's broader theoretical framework about economic development and institutional evolution. This is a foundational theoretical concept rather than a specific policy mechanism or market operation.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it describes how agricultural systems adapt and evolve in response to changing legal, social, and economic environments. It also has some S5 relevance regarding the identity and policy frameworks that enable different agricultural arrangements.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by illuminating the structural mechanisms behind agricultural productivity improvements and showing how institutional changes drive economic development. It explains why some regions advanced economically while others remained stagnant, making it a key analytical framework in Smith's theory.