coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

65
examples/infospace-with-history/output/evaluations/natural_state_of_employments.md Normal file
View File

@@ -0,0 +1,65 @@
---
entity_slug: natural_state_of_employments
evaluator: null
evaluated_at: '2026-02-23T06:01:17.887745'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a distinct economic concept - the baseline
condition where market forces operate without artificial interference. It's precise
in describing the mechanism of wage/profit adjustment and compensation of inequalities,
though it could be slightly more concise.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's text from Book I, Chapter
10, where he explicitly discusses the "natural state" as a theoretical baseline
for analyzing how policy interventions create artificial inequalities. The entity
accurately reflects Smith's actual argument about perfect liberty and market equilibration.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"General Theory" is the correct domain placement as this represents
a foundational theoretical concept that underpins Smith''s broader analysis of
wages, profits, and market mechanisms. It''s not specific to any particular industry
or policy but serves as a theoretical framework.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This concept has moderate VSM relevance as it relates to S2 (coordination/anti-oscillation)
through its description of market self-regulation and equilibration mechanisms.
However, it's primarily a theoretical baseline rather than an active system component,
making it somewhat abstract for direct VSM mapping.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides significant explanatory power by establishing the
theoretical foundation against which Smith measures actual economic conditions
and policy effects. It illuminates the fundamental mechanism of market equilibration
and serves as a crucial analytical tool for understanding departures from natural
market operations.
---
# Evaluation: Natural State Of Employments
## definition_precision — 4.0 / 5.0
The definition clearly captures a distinct economic concept - the baseline condition where market forces operate without artificial interference. It's precise in describing the mechanism of wage/profit adjustment and compensation of inequalities, though it could be slightly more concise.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's text from Book I, Chapter 10, where he explicitly discusses the "natural state" as a theoretical baseline for analyzing how policy interventions create artificial inequalities. The entity accurately reflects Smith's actual argument about perfect liberty and market equilibration.
## domain_placement — 5.0 / 5.0
"General Theory" is the correct domain placement as this represents a foundational theoretical concept that underpins Smith's broader analysis of wages, profits, and market mechanisms. It's not specific to any particular industry or policy but serves as a theoretical framework.
## vsm_relevance — 3.0 / 5.0
This concept has moderate VSM relevance as it relates to S2 (coordination/anti-oscillation) through its description of market self-regulation and equilibration mechanisms. However, it's primarily a theoretical baseline rather than an active system component, making it somewhat abstract for direct VSM mapping.
## explanatory_value — 5.0 / 5.0
This entity provides significant explanatory power by establishing the theoretical foundation against which Smith measures actual economic conditions and policy effects. It illuminates the fundamental mechanism of market equilibration and serves as a crucial analytical tool for understanding departures from natural market operations.