Files

tegwick a9ca0adfcf feat(example): add per-entity LLM evaluations for 985 WoN entities (S3.3)

Batch evaluation of all 988 entities via OpenRouter. 984 succeeded on
first pass; 3 failed (network errors). eval-summary --update-metrics
written with per_entity_mean=3.9556.

Viability dashboard: 6/6 PASS
  redundancy_ratio   0.0061  (max 0.10)
  coverage_ratio     0.6190  (min 0.40)
  coherence_comps    0.0000  (max 3)
  consistency_cycles 0.0000  (max 0)
  granularity_entropy 2.6748 (min 1.0)
  per_entity_mean    3.9556  (min 3.5)

Dimension breakdown (mean across 985 entities):
  definition_precision  3.62
  source_grounding      4.36
  domain_placement      4.56
  vsm_relevance         3.31
  explanatory_value     3.94

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-02-23 09:36:46 +01:00

3.2 KiB

Raw Blame History

entity_slug, evaluator, evaluated_at, overall_score, scores

entity_slug

evaluator

evaluated_at

overall_score

scores

silver_money

null

2026-02-23T06:21:22.071795

4.2

name	value	max_value	rationale
definition_precision	4.0	5.0	The definition clearly identifies silver as a specific medium of exchange with distinct characteristics (primary metal, accounting standard, medium-sized transactions). It avoids circularity and captures a concrete monetary concept rather than a vague umbrella term.

name	value	max_value	rationale
source_grounding	5.0	5.0	This entity is directly grounded in Smith's actual discussion of monetary metals in Book I, Chapter 5, where he extensively analyzes silver's role in commercial transactions and accounting systems. The characterization aligns closely with Smith's text.

name	value	max_value	rationale
domain_placement	5.0	5.0	The "Exchange" domain is perfectly appropriate for silver money, as it represents a fundamental medium of exchange mechanism. This is precisely the conceptual category where monetary instruments belong in economic analysis.

name	value	max_value	rationale
vsm_relevance	3.0	5.0	Silver money maps most naturally to S1 (primary operations) as a basic operational tool for transactions, but it's somewhat VSM-neutral as it functions more as an infrastructure element than a distinct system component. It enables rather than embodies specific VSM functions.

name	value	max_value	rationale
explanatory_value	4.0	5.0	This entity provides genuine explanatory power by illuminating the specific monetary mechanism Smith analyzes and its role in facilitating commercial exchange. It captures an important structural element of the economic system rather than merely naming a surface phenomenon.

Evaluation: Silver Money

definition_precision — 4.0 / 5.0

The definition clearly identifies silver as a specific medium of exchange with distinct characteristics (primary metal, accounting standard, medium-sized transactions). It avoids circularity and captures a concrete monetary concept rather than a vague umbrella term.

source_grounding — 5.0 / 5.0

This entity is directly grounded in Smith's actual discussion of monetary metals in Book I, Chapter 5, where he extensively analyzes silver's role in commercial transactions and accounting systems. The characterization aligns closely with Smith's text.

domain_placement — 5.0 / 5.0

The "Exchange" domain is perfectly appropriate for silver money, as it represents a fundamental medium of exchange mechanism. This is precisely the conceptual category where monetary instruments belong in economic analysis.

vsm_relevance — 3.0 / 5.0

Silver money maps most naturally to S1 (primary operations) as a basic operational tool for transactions, but it's somewhat VSM-neutral as it functions more as an infrastructure element than a distinct system component. It enables rather than embodies specific VSM functions.

explanatory_value — 4.0 / 5.0

This entity provides genuine explanatory power by illuminating the specific monetary mechanism Smith analyzes and its role in facilitating commercial exchange. It captures an important structural element of the economic system rather than merely naming a surface phenomenon.

3.2 KiB Raw Blame History