coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions 1 Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/artificial_direction_of_industry.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: artificial_direction_of_industry
evaluator: null
evaluated_at: '2026-02-23T00:35:22.351545'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes artificial direction from natural
market forces and specifies the mechanisms (regulations, prohibitions, incentives)
by which government intervenes. It captures a distinct concept of deliberate resource
misallocation rather than being a vague umbrella term.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's core arguments from Book
IV, Chapter 2, where he extensively critiques government attempts to direct industry
and capital allocation. The concept and examples (domestic vs. foreign manufacturing)
align precisely with Smith's text.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: '"Regulation" is the correct domain placement as this concept specifically
concerns government regulatory intervention in markets. It represents a clear
regulatory mechanism rather than belonging to trade, production, or other economic
categories.'
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S3 (internal regulation) as it represents regulatory
control mechanisms, and potentially S4 (intelligence/adaptation) regarding how
systems respond to environmental pressures. It has clear structural relevance
to organizational control systems.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity illuminates a fundamental mechanism of how government intervention
distorts natural resource allocation patterns and creates inefficiencies. It explains
the structural relationship between regulatory intervention and economic outcomes,
providing genuine analytical insight into market dynamics.
---
# Evaluation: Artificial Direction Of Industry
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes artificial direction from natural market forces and specifies the mechanisms (regulations, prohibitions, incentives) by which government intervenes. It captures a distinct concept of deliberate resource misallocation rather than being a vague umbrella term.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's core arguments from Book IV, Chapter 2, where he extensively critiques government attempts to direct industry and capital allocation. The concept and examples (domestic vs. foreign manufacturing) align precisely with Smith's text.
## domain_placement — 5.0 / 5.0
"Regulation" is the correct domain placement as this concept specifically concerns government regulatory intervention in markets. It represents a clear regulatory mechanism rather than belonging to trade, production, or other economic categories.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S3 (internal regulation) as it represents regulatory control mechanisms, and potentially S4 (intelligence/adaptation) regarding how systems respond to environmental pressures. It has clear structural relevance to organizational control systems.
## explanatory_value — 5.0 / 5.0
This entity illuminates a fundamental mechanism of how government intervention distorts natural resource allocation patterns and creates inefficiencies. It explains the structural relationship between regulatory intervention and economic outcomes, providing genuine analytical insight into market dynamics.