Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.6 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

standard_metal

null

2026-02-23T06:24:45.322528

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies a specific concept - the precious metal serving as the primary monetary basis for a nation's currency system. It avoids circularity and distinguishes this from other monetary concepts, though it could be slightly more precise about the mechanism of designation.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is well-grounded in Smith's actual discussion in Book I, Chapter 5, where he extensively examines how different societies choose metals like gold and silver as their monetary standards. The concept directly reflects Smith's analysis of monetary systems and value measurement.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Regulation" domain assignment is highly appropriate, as the choice and designation of a standard metal represents a fundamental regulatory decision that shapes an entire monetary system. This is clearly a regulatory mechanism rather than a market operation or production concept.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	This entity has moderate VSM relevance, potentially mapping to S3 (internal regulation) as it represents a foundational regulatory standard for economic measurement. However, it's somewhat abstract and doesn't clearly embody the dynamic control functions that characterize strong VSM mappings.

name	value	max_value	rationale
explanatory_value	4.0	5.0	The entity provides good explanatory value by identifying a key structural element that underlies monetary systems and value measurement across different societies. It illuminates how foundational monetary standards are established, though it's more of a structural component than an active mechanism.

Evaluation: Standard Metal

definition_precision — 4.0 / 5.0

The definition clearly identifies a specific concept - the precious metal serving as the primary monetary basis for a nation's currency system. It avoids circularity and distinguishes this from other monetary concepts, though it could be slightly more precise about the mechanism of designation.

source_grounding — 5.0 / 5.0

This entity is well-grounded in Smith's actual discussion in Book I, Chapter 5, where he extensively examines how different societies choose metals like gold and silver as their monetary standards. The concept directly reflects Smith's analysis of monetary systems and value measurement.

domain_placement — 5.0 / 5.0

The "Regulation" domain assignment is highly appropriate, as the choice and designation of a standard metal represents a fundamental regulatory decision that shapes an entire monetary system. This is clearly a regulatory mechanism rather than a market operation or production concept.

vsm_relevance — 3.0 / 5.0

This entity has moderate VSM relevance, potentially mapping to S3 (internal regulation) as it represents a foundational regulatory standard for economic measurement. However, it's somewhat abstract and doesn't clearly embody the dynamic control functions that characterize strong VSM mappings.

explanatory_value — 4.0 / 5.0

The entity provides good explanatory value by identifying a key structural element that underlies monetary systems and value measurement across different societies. It illuminates how foundational monetary standards are established, though it's more of a structural component than an active mechanism.

3.6 KiB Raw Blame History