coulomb/markitect-main
2
0
Fork 0
Code Issues 133 Pull Requests Actions 1 Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/combination_of_masters.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: combination_of_masters
evaluator: null
evaluated_at: '2026-02-23T04:56:52.161555'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly captures a specific phenomenon - the tacit agreement
among employers regarding wage levels - and distinguishes between the natural
state of maintaining wages and the more secretive efforts to lower them. The concept
is well-bounded and avoids circularity.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity directly reflects Smith's explicit discussion in Book I,
Chapter 8 about how masters naturally combine to keep wages low, conducted with
"silence and secrecy." The definition accurately captures Smith's observation
about this being a constant, tacit agreement.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the appropriate domain since this describes a mechanism
that regulates wage levels in the labor market. The combination of masters functions
as a regulatory force that constrains wage increases and attempts to suppress
wages below natural rates.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This maps well to S3 (internal regulation) as it represents a regulatory
mechanism within the economic system that maintains control over wage levels.
It could also relate to S2 (coordination) as it involves coordinated action among
employers to prevent wage oscillations.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity illuminates a crucial structural mechanism in Smith's analysis
of how labor markets actually function, explaining why wages tend to remain at
subsistence levels despite theoretical bargaining power. It reveals the asymmetric
power dynamics that shape wage determination.
---
# Evaluation: Combination Of Masters
## definition_precision — 4.0 / 5.0
The definition clearly captures a specific phenomenon - the tacit agreement among employers regarding wage levels - and distinguishes between the natural state of maintaining wages and the more secretive efforts to lower them. The concept is well-bounded and avoids circularity.
## source_grounding — 5.0 / 5.0
This entity directly reflects Smith's explicit discussion in Book I, Chapter 8 about how masters naturally combine to keep wages low, conducted with "silence and secrecy." The definition accurately captures Smith's observation about this being a constant, tacit agreement.
## domain_placement — 5.0 / 5.0
"Regulation" is the appropriate domain since this describes a mechanism that regulates wage levels in the labor market. The combination of masters functions as a regulatory force that constrains wage increases and attempts to suppress wages below natural rates.
## vsm_relevance — 4.0 / 5.0
This maps well to S3 (internal regulation) as it represents a regulatory mechanism within the economic system that maintains control over wage levels. It could also relate to S2 (coordination) as it involves coordinated action among employers to prevent wage oscillations.
## explanatory_value — 5.0 / 5.0
This entity illuminates a crucial structural mechanism in Smith's analysis of how labor markets actually function, explaining why wages tend to remain at subsistence levels despite theoretical bargaining power. It reveals the asymmetric power dynamics that shape wage determination.