coulomb/markitect-main
Archived
2
0
Fork 0
Code Issues 135 Pull Requests Actions Projects 12 Releases 1 Wiki Activity

feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Browse Source 
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Bernd Worsch
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

64
examples/infospace-with-history/output/evaluations/real_exchange_rate.md Normal file
View File

@@ -0,0 +1,64 @@
---
entity_slug: real_exchange_rate
evaluator: null
evaluated_at: '2026-02-23T06:15:34.599192'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly distinguishes real exchange rate from nominal/official
rates by focusing on actual market conditions and coin degradation. It precisely
identifies the mechanism (wear, clipping, debasement) that creates the divergence
from mint standards.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This concept is directly grounded in Smith's analysis in Book IV, Chapter
3, where he extensively discusses how actual exchange rates differ from computed
rates due to the physical condition of circulating coins. Smith uses this distinction
to critique superficial interpretations of trade balances.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate, as this concept deals
specifically with currency exchange mechanisms and international monetary transactions.
It sits naturally within Smith's broader discussion of international trade and
monetary systems.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents crucial market intelligence about true currency values that differs
from official data. It also has S3 relevance as it reveals the actual operational
reality versus formal accounting measures.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This concept provides significant explanatory power by revealing why
apparent trade imbalances may be misleading and how market mechanisms adjust for
currency degradation. It illuminates a key structural relationship between monetary
conditions and international trade flows.
---
# Evaluation: Real Exchange Rate
## definition_precision — 4.0 / 5.0
The definition clearly distinguishes real exchange rate from nominal/official rates by focusing on actual market conditions and coin degradation. It precisely identifies the mechanism (wear, clipping, debasement) that creates the divergence from mint standards.
## source_grounding — 5.0 / 5.0
This concept is directly grounded in Smith's analysis in Book IV, Chapter 3, where he extensively discusses how actual exchange rates differ from computed rates due to the physical condition of circulating coins. Smith uses this distinction to critique superficial interpretations of trade balances.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate, as this concept deals specifically with currency exchange mechanisms and international monetary transactions. It sits naturally within Smith's broader discussion of international trade and monetary systems.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents crucial market intelligence about true currency values that differs from official data. It also has S3 relevance as it reveals the actual operational reality versus formal accounting measures.
## explanatory_value — 5.0 / 5.0
This concept provides significant explanatory power by revealing why apparent trade imbalances may be misleading and how market mechanisms adjust for currency degradation. It illuminates a key structural relationship between monetary conditions and international trade flows.