feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)
Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on first pass; 3 failed (network errors). eval-summary --update-metrics written with per_entity_mean=3.9556. Viability dashboard: 6/6 PASS redundancy_ratio 0.0061 (max 0.10) coverage_ratio 0.6190 (min 0.40) coherence_comps 0.0000 (max 3) consistency_cycles 0.0000 (max 0) granularity_entropy 2.6748 (min 1.0) per_entity_mean 3.9556 (min 3.5) Dimension breakdown (mean across 985 entities): definition_precision 3.62 source_grounding 4.36 domain_placement 4.56 vsm_relevance 3.31 explanatory_value 3.94 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,64 @@
|
||||
---
|
||||
entity_slug: degradation_of_coin
|
||||
evaluator: null
|
||||
evaluated_at: '2026-02-23T05:05:18.055968'
|
||||
overall_score: 4.2
|
||||
scores:
|
||||
- name: definition_precision
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: The definition clearly identifies degradation of coin as a specific process
|
||||
involving physical wear, deliberate clipping, or official debasement that reduces
|
||||
precious metal content. It avoids circularity and captures a distinct monetary
|
||||
phenomenon with measurable effects on value.
|
||||
- name: source_grounding
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This concept is directly grounded in Smith's text, particularly in Book
|
||||
I, Chapter 5, where he extensively discusses how coin degradation affects monetary
|
||||
stability and the real value of contracts. Smith provides historical examples
|
||||
and treats this as a fundamental monetary problem.
|
||||
- name: domain_placement
|
||||
value: 4.0
|
||||
max_value: 5.0
|
||||
rationale: '"Regulation" is an appropriate domain since coin degradation relates
|
||||
to monetary standards and government oversight of currency quality. However, it
|
||||
could also fit in a "Monetary Theory" domain, as it''s fundamentally about the
|
||||
mechanics of money itself.'
|
||||
- name: vsm_relevance
|
||||
value: 3.0
|
||||
max_value: 5.0
|
||||
rationale: This entity has moderate VSM relevance, primarily mapping to S3 (internal
|
||||
regulation) as it concerns maintaining monetary standards and quality control.
|
||||
It also touches S2 (coordination) since degraded coins create transaction difficulties
|
||||
and market instabilities.
|
||||
- name: explanatory_value
|
||||
value: 5.0
|
||||
max_value: 5.0
|
||||
rationale: This entity provides excellent explanatory power by illuminating a key
|
||||
mechanism behind monetary instability and the erosion of fixed-value contracts
|
||||
over time. It explains structural relationships between physical currency conditions
|
||||
and broader economic effects that Smith emphasizes.
|
||||
---
|
||||
|
||||
# Evaluation: Degradation Of Coin
|
||||
|
||||
## definition_precision — 4.0 / 5.0
|
||||
|
||||
The definition clearly identifies degradation of coin as a specific process involving physical wear, deliberate clipping, or official debasement that reduces precious metal content. It avoids circularity and captures a distinct monetary phenomenon with measurable effects on value.
|
||||
|
||||
## source_grounding — 5.0 / 5.0
|
||||
|
||||
This concept is directly grounded in Smith's text, particularly in Book I, Chapter 5, where he extensively discusses how coin degradation affects monetary stability and the real value of contracts. Smith provides historical examples and treats this as a fundamental monetary problem.
|
||||
|
||||
## domain_placement — 4.0 / 5.0
|
||||
|
||||
"Regulation" is an appropriate domain since coin degradation relates to monetary standards and government oversight of currency quality. However, it could also fit in a "Monetary Theory" domain, as it's fundamentally about the mechanics of money itself.
|
||||
|
||||
## vsm_relevance — 3.0 / 5.0
|
||||
|
||||
This entity has moderate VSM relevance, primarily mapping to S3 (internal regulation) as it concerns maintaining monetary standards and quality control. It also touches S2 (coordination) since degraded coins create transaction difficulties and market instabilities.
|
||||
|
||||
## explanatory_value — 5.0 / 5.0
|
||||
|
||||
This entity provides excellent explanatory power by illuminating a key mechanism behind monetary instability and the erosion of fixed-value contracts over time. It explains structural relationships between physical currency conditions and broader economic effects that Smith emphasizes.
|
||||
Reference in New Issue
Block a user