coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

63
examples/infospace-with-history/output/evaluations/competition_among_sellers.md Normal file
View File

@@ -0,0 +1,63 @@
---
entity_slug: competition_among_sellers
evaluator: null
evaluated_at: '2026-02-23T05:01:36.700535'
overall_score: 4.4
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition is precise and captures a specific market mechanism -
the competitive response of sellers when supply exceeds demand. It clearly distinguishes
this from other forms of competition by focusing on the excess inventory disposal
scenario.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's text from Book I, Chapter
7, which explicitly discusses how competition among sellers increases when quantity
exceeds effectual demand. The concept and language align closely with Smith's
actual analysis of market price dynamics.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate as this entity describes
a fundamental mechanism within market transactions. Competition among sellers
is a core component of how exchange processes function and prices are determined.
- name: vsm_relevance
value: 3.0
max_value: 5.0
rationale: This entity has moderate VSM relevance, potentially mapping to S2 (coordination)
as it represents a self-regulating mechanism that prevents price oscillations
from persisting. However, it could also be viewed as part of S1 operations or
as VSM-neutral market dynamics.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides excellent explanatory value by illuminating a specific
causal mechanism in price formation - how seller rivalry under excess supply conditions
drives market prices below natural prices. It explains the "how" of market adjustment,
not just the "what."
---
# Evaluation: Competition Among Sellers
## definition_precision — 4.0 / 5.0
The definition is precise and captures a specific market mechanism - the competitive response of sellers when supply exceeds demand. It clearly distinguishes this from other forms of competition by focusing on the excess inventory disposal scenario.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's text from Book I, Chapter 7, which explicitly discusses how competition among sellers increases when quantity exceeds effectual demand. The concept and language align closely with Smith's actual analysis of market price dynamics.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate as this entity describes a fundamental mechanism within market transactions. Competition among sellers is a core component of how exchange processes function and prices are determined.
## vsm_relevance — 3.0 / 5.0
This entity has moderate VSM relevance, potentially mapping to S2 (coordination) as it represents a self-regulating mechanism that prevents price oscillations from persisting. However, it could also be viewed as part of S1 operations or as VSM-neutral market dynamics.
## explanatory_value — 5.0 / 5.0
This entity provides excellent explanatory value by illuminating a specific causal mechanism in price formation - how seller rivalry under excess supply conditions drives market prices below natural prices. It explains the "how" of market adjustment, not just the "what."