coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

65
examples/infospace-with-history/output/evaluations/statutes_of_apprenticeship_effects.md Normal file
View File

@@ -0,0 +1,65 @@
---
entity_slug: statutes_of_apprenticeship_effects
evaluator: null
evaluated_at: '2026-02-23T06:25:36.532758'
overall_score: 4.2
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific asymmetric effect of apprenticeship
laws - their ability to raise wages above natural rates during prosperity versus
forcing them below during decline. The concept is distinct and well-bounded, though
it could be slightly more precise about the mechanisms involved.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity directly reflects Smith's analysis in Book I, Chapter 7,
where he explicitly discusses how apprenticeship statutes have different effects
during prosperity versus decline, and notes their more durable effect in raising
wages than reducing them. The temporal aspect about effects lasting only as long
as workers' lives is also grounded in the source text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement as this entity specifically
concerns the effects of legal statutes (apprenticeship laws) on labor markets.
This is clearly a regulatory mechanism rather than a natural market phenomenon.'
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, primarily mapping to S2 (coordination)
as it describes how regulations attempt to coordinate labor markets, though with
unintended oscillatory effects. It also touches on S3 (internal regulation) through
its regulatory mechanism, but the mapping is not as natural as more operational
concepts.
- name: explanatory_value
value: 4.0
max_value: 5.0
rationale: The entity provides genuine explanatory power by illuminating the asymmetric
and temporal dynamics of how regulatory interventions affect wage determination.
It reveals an important structural mechanism about how legal constraints interact
with market forces over time, rather than merely describing a surface phenomenon.
---
# Evaluation: Statutes Of Apprenticeship Effects
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific asymmetric effect of apprenticeship laws - their ability to raise wages above natural rates during prosperity versus forcing them below during decline. The concept is distinct and well-bounded, though it could be slightly more precise about the mechanisms involved.
## source_grounding — 5.0 / 5.0
This entity directly reflects Smith's analysis in Book I, Chapter 7, where he explicitly discusses how apprenticeship statutes have different effects during prosperity versus decline, and notes their more durable effect in raising wages than reducing them. The temporal aspect about effects lasting only as long as workers' lives is also grounded in the source text.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement as this entity specifically concerns the effects of legal statutes (apprenticeship laws) on labor markets. This is clearly a regulatory mechanism rather than a natural market phenomenon.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, primarily mapping to S2 (coordination) as it describes how regulations attempt to coordinate labor markets, though with unintended oscillatory effects. It also touches on S3 (internal regulation) through its regulatory mechanism, but the mapping is not as natural as more operational concepts.
## explanatory_value — 4.0 / 5.0
The entity provides genuine explanatory power by illuminating the asymmetric and temporal dynamics of how regulatory interventions affect wage determination. It reveals an important structural mechanism about how legal constraints interact with market forces over time, rather than merely describing a surface phenomenon.