feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-02-23 09:36:46 +01:00
parent 81a4c8796a
commit a9ca0adfcf
986 changed files with 63216 additions and 1 deletions

View File

@@ -0,0 +1,64 @@
---
entity_slug: silver_price_variation
evaluator: null
evaluated_at: '2026-02-23T06:21:30.147355'
overall_score: 4.6
scores:
- name: definition_precision
value: 4.0
max_value: 5.0
rationale: The definition clearly specifies what is being measured (silver value
relative to other commodities, particularly corn) and identifies the key causal
factors (supply from mines, demand from commerce). It avoids circularity and captures
a distinct economic phenomenon rather than a vague concept.
- name: source_grounding
value: 5.0
max_value: 5.0
rationale: This entity is directly grounded in Smith's detailed empirical analysis
in Book I, Chapter 11, where he extensively examines historical silver price data
relative to corn over four centuries. The entity accurately reflects Smith's actual
investigation rather than imposing external concepts.
- name: domain_placement
value: 5.0
max_value: 5.0
rationale: The "Exchange" domain is perfectly appropriate since this entity concerns
the relative exchange values between silver and other commodities over time. This
is fundamentally about exchange relationships and price mechanisms in markets.
- name: vsm_relevance
value: 4.0
max_value: 5.0
rationale: This entity maps well to S4 (intelligence/environmental adaptation) as
it represents the economic system's response to environmental changes in silver
supply and commercial demand. It also connects to S1 as it affects primary market
operations through changing relative values.
- name: explanatory_value
value: 5.0
max_value: 5.0
rationale: This entity provides substantial explanatory power by illuminating the
mechanism through which precious metal values adjust to supply and demand changes,
serving as evidence for Smith's broader theories about wealth, commerce, and monetary
systems. It reveals structural relationships between mining output, commercial
development, and price formation.
---
# Evaluation: Silver Price Variation
## definition_precision — 4.0 / 5.0
The definition clearly specifies what is being measured (silver value relative to other commodities, particularly corn) and identifies the key causal factors (supply from mines, demand from commerce). It avoids circularity and captures a distinct economic phenomenon rather than a vague concept.
## source_grounding — 5.0 / 5.0
This entity is directly grounded in Smith's detailed empirical analysis in Book I, Chapter 11, where he extensively examines historical silver price data relative to corn over four centuries. The entity accurately reflects Smith's actual investigation rather than imposing external concepts.
## domain_placement — 5.0 / 5.0
The "Exchange" domain is perfectly appropriate since this entity concerns the relative exchange values between silver and other commodities over time. This is fundamentally about exchange relationships and price mechanisms in markets.
## vsm_relevance — 4.0 / 5.0
This entity maps well to S4 (intelligence/environmental adaptation) as it represents the economic system's response to environmental changes in silver supply and commercial demand. It also connects to S1 as it affects primary market operations through changing relative values.
## explanatory_value — 5.0 / 5.0
This entity provides substantial explanatory power by illuminating the mechanism through which precious metal values adjust to supply and demand changes, serving as evidence for Smith's broader theories about wealth, commerce, and monetary systems. It reveals structural relationships between mining output, commercial development, and price formation.