Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

treasure_accumulation

null

2026-02-23T06:33:57.551831

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly distinguishes treasure accumulation as the hoarding of precious metals by governments and individuals, with specific emphasis on Smith's critique of this practice. It avoids circularity and captures a distinct economic behavior rather than a vague concept.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Book IV, Chapter 1 of The Wealth of Nations, where Smith extensively critiques mercantile policies of hoarding precious metals. The characterization of Smith's argument about dead capital versus productive employment accurately reflects his position in the source text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Accumulation" domain is perfectly appropriate for this concept, as treasure accumulation represents a specific form of wealth accumulation that Smith analyzes. This fits naturally within the broader economic category of how societies build and store wealth.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/adaptation) as it represents a flawed strategy for national economic security, or S5 (policy/identity) as it reflects fundamental beliefs about what constitutes national wealth. However, it's more of a policy critique than a clear systemic function.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides strong explanatory value by illuminating Smith's critique of mercantile thinking and the mechanism by which hoarded wealth becomes unproductive "dead capital." It helps explain a key structural problem in economic thinking that Smith sought to correct.

Evaluation: Treasure Accumulation

definition_precision — 4.0 / 5.0

The definition clearly distinguishes treasure accumulation as the hoarding of precious metals by governments and individuals, with specific emphasis on Smith's critique of this practice. It avoids circularity and captures a distinct economic behavior rather than a vague concept.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Book IV, Chapter 1 of The Wealth of Nations, where Smith extensively critiques mercantile policies of hoarding precious metals. The characterization of Smith's argument about dead capital versus productive employment accurately reflects his position in the source text.

domain_placement — 5.0 / 5.0

The "Accumulation" domain is perfectly appropriate for this concept, as treasure accumulation represents a specific form of wealth accumulation that Smith analyzes. This fits naturally within the broader economic category of how societies build and store wealth.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S4 (intelligence/adaptation) as it represents a flawed strategy for national economic security, or S5 (policy/identity) as it reflects fundamental beliefs about what constitutes national wealth. However, it's more of a policy critique than a clear systemic function.

explanatory_value — 4.0 / 5.0

The entity provides strong explanatory value by illuminating Smith's critique of mercantile thinking and the mechanism by which hoarded wealth becomes unproductive "dead capital." It helps explain a key structural problem in economic thinking that Smith sought to correct.

3.6 KiB Raw Blame History